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CHAPTER I 

^ • PURPOSE OF STUDY 



Introduction 



Broadly speaking, the purpose of education is to. change people in 
ways that enhance theif development and that of^society 'as a whole. 
There is no ^question i that schools and colleges do change children and 
young people. Hundreds of studies have documented the outcomes of 
formal schooling and determined that in general they^are substantial 
and enduring (see, for example, Hymah, Wright, and Reed, 1975). Of 
course the purpose of formal schooling^ at whatever level, is to 
socialize the young in .preparation for thejroles and responsibiliti 
of adulthood. Outcomes op "effects" research, therefore, has focused 
oh cognitive^ arfd affective development rather^than on the applications 
or impact of* education to functioning in everyday life. 

For adult edu^ primary ; 

importance. Formost adu1ts,;knowledge, skills, insight or under- 
standing are not ends in themselves, or acquired f6r future_apppli-/ 
cationi instead, they are' ^ means for adults to sol ve_ immediate problems 
or improve their proficiencies or circumstances In the everyday world 
-of ..work j, , family, and community life (Darke^nwald & Merriam^ 1982). ' 
Thus, outcome research in on 
"impact" as just described and not on the kinds of variables employed 
to gauge the effects of formal schooling.^ v * 

r Unfortunately,' as discussed in^the next chapter, very feiw well- \ 

designed, jarge-scalg studies have been conducted to determi ne the_ 
impact of participation in any form of adult . education, _ JThe need for 
impact research on adult basic education (ABE) is especial ly acute, 
fog the individual and societal needs addressed by these programs are 
urgent. For most partici pants ,_ ABE is indeed a "last gamble on edu- 
cation." And the stakes are extremely higij (Mezirow, Darkenwald, and 
Knox, 1975). 

Purpose of Study , 

\ % ' ' 

The; present study, though basical ly concerned with analyzing the 
impact of adult basic education in the state of New Jersey, is more * ■ 
encompassing than its title suggests. Although it could be asserted > 
that this volume contains three studies in one,^it is more accurate to 
say that the research consisted of three interrelated components, the 
most .crucial being that whtch addresses the outcomes and impact jafe 
participation. This component, is crucial because the import arid 
utility of the other components depend in large part on its results. 



The three principal goals (components) of the project were these: 



(1 ) To determine _the imjDatt of adult basic skills education in New 
Jersey - in- term§ of (a) attainment of students 1 own goals for participa- 
tion and (b) program effects on* tangible indicators of social arid 
economic well being.. * ' 



(2) *To ascertain the nature arid import of costs and benefits for 
Jersey's adult high completion program, including a comparison' of the .GED 
and adul-t high school > options^ • f 1 

(3) To design a model , instrumentation, and procedures for ongoing 
statewide student fol 1 ow-up. 




Jhe need and rationale for the outcome, component 

relates both to the importance ot furthering tested knowledge of the 
effects of participation in adult basic education and of securing 
^bottom-line" evidence of program impact i/n order t£ meet pressing demands 
for accountability in these times of shrinking state and federal support 
for^educational programs. Pyt bluntly, iri/NeW Jersey and most other 
states, future funding for adult basic education (including high school 
completion) will depend^ in large part on credible evidence of program . 
Success or impacts Such evidence need not always be; in a 
c^ost^ben^fit .analysis ? but efficiency or "bang for the buck" is always a 
p?ri m ou5t concern. To conduct a cpst benef.its: Study one needs to ascer- 
tain what "benefits are in fact salient , for participants in the program 
being ana1yzed.„_ It is in.-thjs wayrrldentif ication of relevant benefits-. , 
that thi si the first component of the /Study, was cl bse ly 1 i nked to the 
second. */ • 

Very 'briefly (see Chapter JII for details), the outcome component #T 
involved interviewing a stratified random sample of New Jersey adult 
'basic education participants (/fricTuding, those preparing for the GED^ or 
enrolled in adult high schools) , most, of whom had been in the program, 
or discontinued attendance, between ^ October, 1 982 and May, 1 983. English 
as a second language (ESL) students* were not included in the.sampl e, \nor 
were students enrol led in programs-designed for special populations., \ 
such as the retarded, prisoners, the mental ly 'il 1 , and the aged,. (-Respon- 
dents we re interviewed by telephone about numerous outcome variables, I 
including, for example, extent of personal, goa-1- accomplishment', impact \ 
of' participation on their children's school performance, emp 1 oyment ana; 
1ic assistance status, 



application of basic skills to real -life 
situations, and plans for "further education or training. Two hundred 
ninety-four interviews were completed for an ext regie ly high adjusted 
response rate of 97 percent. .. - ; . 

Strictly speaking, the findi ngs are not general iza We to states v 
other than New Jersey. New Jersey, however, Jjjqtrtte ty pica \ in many 
respects of other industrialized states, particul arTy -ir^ the Northeast- 
Mi ddl a Atlantic area and the Midwest* It would be surprising^ at least 




irigs much 



replication 
at ^variance 



studies in industrialized states pesatted in find- 
frorji our own. • 



costs were included and s 
the benefits ana1^i|^Was 
had obtained a hi gh $chpo 
to col Jectjng Vhe^bene'^ t 
were included in i ' the anal 



Although both ABE and adult high school ' 
par'ately analysed in this part j)f<t)ie^ study, 
jconfined to outcomes reported by adults who 
I credential approximately 14 to 16 months prior 
•_data. Both monetary and npn^mpnetary, .benefits 
^is. However, unl ike the initial outcome 
sed on "credential -effect" benefits presumably 
diploma. A stratified random ^ 
500 graduates who were then' 



study , this com ponent foe 
att ri bu ta b[e tc o bt ai n i ng I a hi gh school 
sampling procedure was' employed to select 

mailed 'a two-page questionnaire. To enable comparison of costs and 
benefits of the state's t^?p principal routes to a high school credential, 
the sampling plan was designed to include 300 GED and 200 adult high 
school graduates. The overall adjusted response rate was 60 percent. 



Although the / particularities of New Jersey's funding mechanisms pre 
elude generalizations to (other states regardi ng costs, the model and f 
procedures employed were (intended to be exemplary and can be modified 
fit the needs of states other than New Jersey- As with the outcome 
findings, the benefits identified are unlikely to be much at variance 
with those realized 1n other industrialized states. However, this . is, 
opinion" that needs to be; substantiated by replication studies in- other 
states. ■ " i . ' . * 



to 



an 



Statewide Fol 1 ow-Up Component . / The final goal of the project was 
to design a. model , instrumentation,' and procedures for ongoing statewide 
student fpllowrup. To a^.compl i sh this goal, it was necessary to under- 
take the preceding research activities in order tp. identify /the outcome 
variables important and feasible to incorporate in a follow-up model . 
Fpr example, most past outcome studies have included a questipn^n 
whether the student or graduate voted in the last election. Although 
this appears to be an 'important and relevant question, the research 
findings .Indicate that participation in ABE does not meaningfully in- 
fluence voter registration or vpting behavior. Consequently, unless 
voting is deemed a high priority outcome, it makes np sense to include 
such an- item in a fnl 1 ow-up questionnai re (particularly since such a 
questionnaire woul d have to be very brief. to ensure a. respectable re- 
sponse rate)., An : . example of an important but unfeasible variable is 
impact on earnings.. The reason, as we discovered ourselves, is that too 
many complex questions need tor be asked to arrive at an answer* 

- This component of the} project was obviously addressed to practical, 
concerns at both % the states and local program levels. Local programs ; 
lack the human and fiscal resources j;and tested .data collection instru- 
ments for "tracking" their basic skills students to determine program 
impact; As a result, program evaluation ^and improvement efforts have 
been hindered and so, too, has local -level accountability ; for, state and 
-federal funds. At the state level * the situation is similar* Lack of 



ERLC 



ERIC 



adequate, ongoing foil bw-iip data has handicapped efforts to plan ration- 
ally /or* statewide program improvement. Even ipdre pressing, perhaps, 
is therheed to demonstrate to legislative arid-executive bran 
makers that public funds. invested jh adult; education are yielding impor- 
tant benefits to the' public at minimal cost* Gross measures of impact* • 
such as number of adults served arid cost per contact hour, N are tod 'crude 
and 1 imited to- make a convincing case for continued or increased, funding. 
Comprehensive data on specific, highly significant benefits to partici- 
pants arid society are required if adult basip education is to^thrive, or 
^perhaps even survive, in the 1980Si 

One final point bears m^ this project 

was designed to be as conceptual ly- sophisticated and technical ly rigorous 
as pos si ble within the constraints of a modest budget and one-year time 
frame;- Every effort was made to avoid the shortcomings^ pre vi ous 
research, especially in regard to identification' of relevant outcome _'_ 
variables,; the need for strict random sampling, and the absolutely essen- 
tial requi remerit of an adeguate respqrise rate. ~0f course, we also at- 
tempted .to capitalize on the strengths.^of prevl [ous s.tudies. Tfie next 
chapter reviews those past outcome studies judged to be bf acceptable - 
technical quality and therefore of value in planning^ this study an8 
interpreting its findings, v 
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• CHAPTER II. 
PREVIOUS RESEARCH 



Introduction 



Research pn the outcomes of participation in adult basic education 
programs has been 'conducted^ fp^various reasons. .An Important reasori 
for outcome studies Is to enable administrators to evaluate the strengths 
and' weaknesses of tbei r programs. Another purpose 1s to provide teachers 
with Information about the effectiveness of their tnst ryctldn. Finally, 
a crucial reason for such studies Is to provide information on the bene- 
fits of ABE, both for the Individual and to society, In order to justify 
continued financial support of such programs by the government. 



Outcomes arid Indicators " 



Before these studies may be carried but, the expected outcomes must 
be clearly defined. .First* what is the overall goal of the ABE program? 
According to the Adult Education Act of 1966*, as quoted In Mez 1 row , 
- Darkenwald and Knox (1975), the purpose of ABE programs Is to\educate 
adults "whose inability to speak , write, or read the English language 
constitutes a substantial Impal rmerit of their ability to get br\ retain 
employment commensurate with their real ability." 'Adult Basic Education 
was defined a> education designed to "help eliminate such Inability" and 
"raise the education level of such Individuals" with the intention of 
"making them less ;likely to; become* dependent on others," "Improving their 
ability to benefit from occupational training and otherwise increasing 
their opportunities for more productive and profitable employment, _\ and 
"making them better able to meet their adult- respbhslbili tfes^ " In\ 
short, the gbal~^bf^ABE~ir-tb enable Its participants "to become more \ 
employable, productive, and responsible citizens,." 

' v - - ' \ 

These ambiti bus* goals certain ily are significant both^or the individ- 
ual arid society. The problem for research is how to determine whether \ 
these; and others, nave -been reached^ What specific outcomes should be 
expected as a result of participation? What are the indicators of 
"success" in ABE? Researchers have varied in their selection of signifi^- 
carit outcomes^ In general, the outcomes studied fa 1>1 Into four^magor 
categories:^ economic outcomes, educational jgutcomes, family and socially 
related outcomes, and personal "outcomes. 

" S w __ 

Economic outcomes are among thosejgost frequently studied^ both 

because they are easiest to measure, and because they provide the most- 

tangible_evidence-of benefit to the individual and community.^ Helping * 

the unertffrlcyedh to qualify for jobs, or helping those__ai (ready Jmployed^to 

qualify for better jobs, is the central purpose of ABE^; according to the 

^dult Education Act. While find 

often studied^ for (this outcome to be significant research must con- 
sider whether the ABE participants /werfe unemployed to begin with. 



Studies have also examined the extent to wh1 ch participation \x\ ABE leads 
to better jabs* promotions, and salary increases. Another factor re- 
lated to Employment; which has beensttidled 1s whether participants have 
increased their job security. An important outcome for society, linked 
to finding employment, 1s the elimination of pub lip assistance to ABE/ 
participants who become self-supporting^ 

• * 

.__ Educational outcomes are also frequently studied. Since the main 
goal of instructlorvln most ABE programs is the Improvement of reading, 
writing, and math skil 1 s, outcomes are usually measured in terms of test 
scores in these areas. Passing the GED test is also used as an Indicator 
of success^ Aside from test scores^sqme researchers have used students*' 
perceptions oftheir basic^skil Is improvement since:, participating 1n ABE. 
Educationally-related outcomes of participation also Include students. 1 
plans for, and actual enrollment in, further education and training. 

__- Outcomes related to participants 1 f ami ly and social life cah be 
very significant. One object of research has been the .effect of 
parents \ participation in ABE on the school performance of their chil- 
dren. Researchers have attempted to determine this effect by asking par- 
ticipants if they helped children with schoo^work more, and 1f- their 
; chi 1 dren we re actual I ly gett 1 ng ^better grades. ' Another varl abl e studl ed 
* is whether parents reported a more active involvement with school per- 
sonnel and organizations. ; 

ABE students' general involvement in social Institutions 1s often 
considered an Important factor to examine. The educationally disadvan- 
taged are thos # e who are least Involved 1n community organizations and who 
often feej alienated from society.. A goal of ABE fs to encourage greater 
social aware lies and involvement. Indicators of strch involvement have' 
included the use of social services and participation in organized" com- 
munity activities, and voting registration and votjing behavior^ * * 

Outcomes that are primarily personal or affective are. Jess fre- 
quently studied because they are : di_fllcu.lt to measure. However, these 
outcomes may be highly signifi cant fdr the individual. The application ; 
of improved skills, as^lrr the Increased reading of newspapers and maga- 
zines, or in the comparison of prices in shopping, is^mdre meaningful to. 
Students than scores on basic skills tests. Some studies have included 
students 1 reports of their actual use of improved skills in daily living. 
.Intangible changes, stfch as improved sielf -concept- and greater self-con- 
fidence are important for success in finding employment and participation 
in community life* Researchers have assessed such changes by asking 
students whether they feeY differently about themselves as a result of 
participation, or feel greater ease in relationships with other people. 

Obviously, the outcomes of participation in ABE are varied and must . 
ber defined careful ly . Unfortunately much past research has been jimi-ted 
by the kinds of outcomes studied or f 1 awed methodological ly. Two' na- 
tional studies (Development Associates, 1980; Kent, 1973) are 'particu- 
larly significant for the size of their samples and the scope of the- 
research. One state-wide study, conducted by; Bdggs in Ohio (1 978) , is- 
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also unusually thorough. - . . / 

?. Other national, state, and local studies which were relatively well- 
designed are ^Iso included in this_ review.^ A number. of very poorly 
executed studies have not been included. There is clearly a heed for 
more rigorous research cm the outcomes of ABE. : 



\ Nation al Studies ' > J " : 

V ; Tf- ; 

c. ** 

i A major national study conducted by William Kent (1973) was begun 
in mid-1971 arid continued for more than two years. The major objective 
was to evaluate the effects of the.ftBE t ._prbgram on its "priority group" 
of students. This group was defined aV adults from "18-44 years old with 
less than 8 years of schooling. " The sample did not include students 
o-v^f; 44 years old, migrants, institutionalized students, and students in 
/ ^KgliSh as a Second Language classes^ The sanip lei Included 2,31.8 students 
in 200 classes, 90 programs, and 15 states. Data were gathered on 
student characteristics, educational goals, arid opinions, as well as 
program arid classroom characteristics^ The students were tested twice 
and iritervi ewed three .times; follow-up intervi ews >ere held at twel ve 
and eighteen month intervals after the initial interviews The first two 
interviews were conducted in person, while the last were generally by 
telephone. Of the totaj^ sample^ 47% we re initially interviewed in classy 
and 15% were intervi e^d^utklde of the classrooms The response rat e^ 
errdrieously computed by Kent as^7%^faS actually 62%s About 74% of 
those initial ly intervi ewed v^re con fol Vow-up inter- 

view; of this group, 79% were reached for the s^cotidfollowrup intervi/ew. 

This study used both test scores and stude^ - 

measures . of academi c outcomes. Students enrol led in the ABE programs 
were given pre- and post-tests with a four month interval. Mean gra5e\^ 
level- gains, between tests were half a grade for reading and three-tenths^ 
of^a grade for math. However, over 26% gained a full grade or more in 
readi ng_achievement and nearly 20% gained a full grade or more ir> math 
achievement. Approximately one-third of all students made, no gain at 
all or even dropped in scores during the four month interval,/ 

In both follow-up interviews, students were asked how much 
believed thei r_abi]ittes to' read^ write, and work with numbers ttad_ im- 
proved during the: pfrf^year. Almost all believed that the1r_ab1|1t1es ^ 
had incresed at least to some extent. Almpst 50% believed that their 
abi jities in readingjiad increased ye ry__ muchj 46% believed their _ mat h_ : . 
ability had increased very much, and 33% believed their writing ability 
had increased very much. • . , 

Studeptsl plans for ^ exam? ped. Inter- 

viewees were asked if they were or planned to enrol T in high school^com- 
pletipn, college, or vocational -technical .training; __ Joth'^at_the_ begins _ 
ning and at the end of the eighteen moth peMod, about tw6*thirds planned * 
on additional vocational or technical training. However, the number of 



_ _ * _ _■ 

students planning to get a high schbdi^iplbma declinedif rqm 91% to 81%) * 
arid the number '.'planning t'a attend, col lege dropped from 60% to 37%, The 
reason for such a drastie change in students 1 plans to enter college 
might have been the realization of these ABE students that a great amount 
of time and study would be required for them to prepare for college work. 

Only 31% of the interviewees stated that their main reason for en- 
rolling in ABE was to get a better job* In initial interviews, students 
were asked if they had looked for work in the past six months; if they 
had difficulty in finding a job due to lack of education; if they were 
currently employed and, if so, how ' many hours worked per week; their 
earnings, and_ their diances of getting ^ a raise and of losing theirjobs* 

In follow-up Interviews^ .interviewees Were asked the same questions i 

and if employed, were also asked if they hadthe same job as when inter- 
viewed I, previously, whether ABE classes had helped them to f™d ? job", 
Jielped them in their present job, if ttiey had, been promoted, and if they 
had greater job security. 

# • 

In general, the students interviewed increased thelremployment and 
earnings. At the time of -the f i rst' interview* 58% had someejob earnings; 
eighteen months later 70% had some job earnings.. The earnings of those 
who worked increased from a mean of $336 per month to a mean, of $407 per 
• month. However, when the effects of the 5 to 6% rate of inflation at 
that time are taken into consideration, combined with the probability 
that the students available for follow-up interviews wer:e--those-who^had 
more .stable employiiierit^ the actual Increase 1n earnings becomes less 
significant. About 6,6% of the employed students had recei ved a raise 
sincere first interview. Of these* 15% believed that ABE helped a 
« little, 20% that it helped some, and 12% that it helped a; lot in their 
getting such a raise.. Almost N 75% of those who worked felt that ABE 
helped them on the job. A" "little more /than half of the employed inter- 
viewees had the same jobs in follow-up/as 1n initial interviews. Of 
the nearly 50% who had changed jobs, 79% preferred their new jobs. 

About 26% of the students at the first interview Were recei vi ng 
' public assistance. This figure decreased to 22% in the final interviews. 
Again, thel-probatriHty that the students available for follow-up inter- 
views we re employed makes this decrease Insignificant. 

/ ' ^ • ' * ' 

In the area of f ami ly and community" Involvement, this study included 
^onjy quest tens in regard to parent-eh1ld_reTat1ohsh1ps._ IntervfeWees 
yf&e asked whether they had school -age (5-18 years) children, and whether 
they had helped children with schoolwork in the past year. About 50% 
of initial interviewees had school-age children; 55% of all initial inter- 
viewees had yelped children with schoolwork in the past year. ,In folloW- 
up interviews, the percentage who had helped children had risen slightly, 
to 58%. The effect of ABE was apparently insignificant. 

: Kent's study does not devote much attention to the primarily personal 
or "affective 11 results of ABE. Students were asked about their primary 
reason for attending ABE classes. About -69% said that .their main reason 
for coming was "mostly to learn something," while 31% came "mostly to get 

u 
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a better job." Forty-eight percent felt that rWdirig was nibs t important 
for them to learru 46% ~f elt math was mbst^inipbWaritr and 6% felt writing 
was most important. . / J 



As ah indicator of the personal application of skills, participants 
were asked in follow-up interviews if tjfiSir reading of newspapers, maga- 
zines, and books had increased" since^BE. thirty-six percent said such 
reading had increased very much, and only 1.5% said riot at all. 

In the first follow-up interview, participants were asked two j 
questions in regard to health information and services. Some 38% said 
that the ABE program gave them information about health; 13% said that 
ABE helped them receive health services. 

:: IP I 

In conclusion, the Kent study found that participation in ABE re- 
sulted in improvement in ba?ic skills^ both according to test scores and 
to students' own perceptions. Benefits also included gains in employ- 
ment, some increase in earnings, and improved skills on the job.' The 
fact that the majority of st educational rather than 

'employment related reasbns is -important. ' the methodology used, con- 
sisting of follow-up ^ extended period of time^ is an 
appropriate-way to determine which may not become apparent 
immediately after participation. The major faults of the study were its 
lack^of attention to the affective changes resulting from ABE and its 
JjmiJted-response-rate. 

An-^Assesment .--of the State-Administered Program of the Adult Education 
^Act, conducted by Development Associates {1980J, was .commissi dried by the . 
Office of Evaluation and Dlssemi nation of USOE in 1978 "(a) to provide 
an analytic description of the Grants to States program, with .particular 
emphasis on program participants; and (b) to identify a set of impact 
measures that can be studied in a longitudinal design." A large part of 
the study was. concerned with program operations and characteristics, 
both at the state and local levels. However, one stated objective! was ' 
to determine ABE" program benefits to participants arid to society, I 

Participant data were collected by site visits to a sample of 111 
local- adult education progams in forty states. Participants, inpluded 
students in ABj:, AHS, and ESL classes. The sample was drawn from a 1 1st „ 
of students registered in the. spring prior to the site visits in November 
December 1979, so it included both people who had completed the classes 
and those who had dropped out. Data wore gathered from- program records 
about the participants 1 characteristics arid attendance. Interviews were 
conducted by telephone. At least three attempts were madetb contact 
each student. The Interview response fate was -38% : , of 3,115 potential 
participants, 1,177 were successfully contacted and interviewed. Due to~~ 
differences between trios e people Interviewed a^B those not reached arid 
the low percentage of thesample contacted, responses are_nbt_ general - 
izable to the fflltire population. Interviewees were more likely to be 
white^ female^ mi ddle-aSed or e^RJerly , and # tb live in rural areas. Also, 
interviewees were more wkely to be still enrolled 1n classes, arid there- 
fore to be more positive about the program. ■ 

: \\y - 1 • is 
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Educational goals were^ stated as most important by respondents for 
enrolling in adult education classes. Interviewees were asked to describe 
the reasons why they enrolled in adult education, and the most frequently, 
reported reason (by 46% of respondents*) was to pass the GED. Other major 
reasons were to acquire basic reading* writing and math ski 1 ls^ {stated by 
33% of respondents) and to learn the English language (22%). About '54% ' 
gay.e mcyre than one reason for enrolling, but when asked to state the one 
most ii|portant reason, 79% gave one of : the abov? reasons. 

Specifically, participants we if the classes Md helped them 

to read* write, and work with humbers better. Almost 75% felt their 
reading skills had improved* 69%. felt their math skills had improved, 
and 66% felt their wnti rig skills had ; improved. * ' * 

The, results of the study indicated that adult basic education may 
often lead to further education or traini ng for participants. At the 
time of the interview, 57% of the respondents were already -in vol ved or 
planned to enroll in bther adult, education programs. Twenty-three per cent 
we re uncertain* and orilyl 7*5%_were riot pi anning to participate, arid 
many of these were elderly adults. . . • * 

When asked'about plans for further education or training* aside 
from adult, education* 58% indicated that they planned to enroll' in the 
future^ most frequently mentioning vocational /technical training (by 29% 
of respondents )i Plans for academie education were also mentioned fre- 
quently (by 26% of respondents}* 

Only 7.7% of interviewees ^ai d that on e-o£-£he_reasons they enrolled 
in adulj ^education courses was to get a job, arid only 5*7% said that 
they wanted to get abetter job. Thirty-eight percent of the inter- 
viewees were employed full -time* arid 14% were empl oyed part-time* When 
asked if the^adult education program had helped t hern get a better job, 
only 17.7% replied affirmatively. In the study's report, it is recognized 
' $hat employment-related gains due to participation in adult, education 
should be assessed more careful ly in future studies. 

The only question specifically directed to .family or community life 
was whether interviewees feltAhat participation in the adult- education 
program_ had helped thein_ il get along better" with their family-; About 51% 
indicated that the program had helped their family relationships* 

Participants^ perceptions: of their pe goal attainment was an 

important factor considered in this study; Interviewees were asked 
whether they hadsuccessfully in the process of reachirig 

what they had hoped, toattainwh&n they first enrolled. Almost 42% 
reported successful ly reaching th,ei r goals and 38% said that their goals 
were partially, attained; 

In addition ! to general §oal .attainment, interviewees were asked 
about specific personal outcomes of attending adult educatiori cl asses. 
•They wereasked If the program had helped t hem' achieve "life goals*" . 
such as getting a drivers license or using a checking account.- About 

■ ■ _ .: v -V. • ■ ' : .. . .' 16 ■ -. 
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25% said that they had achieved such a goal. Participants were also 
asked if the program helped _them^"think better of t Almost 
48% .reported that tney Had an improved self-concept from going to adult 
education classes. 

Final ly^ interviewees, were asked about the most impo result of - 

their participation in adult education.' The six most frequent responses 
were: .learning .to.speak English, learning to read and write, increased 
knowledge (unspecified) , increased self-conf idertce, obtaining a GED, and* 
learning math skills. • 

• ' ' ' 

... Overall, the most significant outcome of participation revealed by 
this study was an improvement in/self-concept. Also significant was 
the fact that 80% of the respondents had enrol led to attain educational 
gpa 1 s , and that almost 80% had at 'least partial ly attained their personal 
goals. However, the results of the study were limited by the low^per- f 
cent age of the sample which was contacted, and by the tendency qfTrespon- a 
dents to.stil 1 be enrol led in the program* * 

Most recently A National I Survey of GED Test Candidates: Prepari* 
tion, Performance, and 18 Month Outcomes (198.3) was conducted by Ronald 
M. Cervero. . One purpose, among others, of this study was to determine " 
the educational and employment outcomes of GED candi dates 1 8 .months after 
they l had taken theses t*_ A nationally represent at i ve s ampl e of :12,646 
BED test candidates .compl eted initial sUrveys at the tiifle they took the 
test, in April and May 1980. At that time, 9530 (75.4%) agreed to par- 
ticipate in a fol low-up study. Participants differed from nonpartici pants 
in that women agreed to participate more than men, and those passing the . 
GEE more than those who -failed. <- Participants were,cjri the average older 
than nonparticipants. ; V 

. ' In October 1981, the follow-up survey was J mailed. to a '20% sample — 
of those who agreed to participate. A total of 458 were completed, a 
24% response rate; TheK response rate was adjusted to 29.5% because 315 
surveys were returned a$ undeliverable. Agai n, respondents were older 
(29 vs. 24 years), had higher GED scores, arrd were more likely to be 
female. Another statistically, significant difference was that nonre-. - 
spondents tended to have completed more years of school than respondents. 
These differences, atid the very low response rate, limit attempts to 
generalize results of the study. ■ - 

* _ . - . ■ / 

, ^~The study of outcomes included only candidates who had passed the 
GED- test, either at the time of the initial survey, or in the 18 month 
peri od before the fol low-up survey* Of the 458 respondentsjto the 
fol 1 ow-up survey, 383 had passed the test arid were included in the study. 

Participants were questioned about their expectations and actual 
outcomes in regard to passing' the GED. Less than: one-third expected 
that getting the GED woul d he-Tp-them to keep their job, get a job promo- 
tion, or get a salary increase*. As ari actual outcome, 1£% reported that 
the GED helped them to keep their job, 2B% toget a job promotion, and 
19% to get a salary increase. Additional lyi 75% expected the GED to 
- ■ • ■ . - '• ; ' * . ■ ;/ • ■ 



help them qualify for a* new job. Fifty- two percent report d that it 
actually did* Seventy-two -percent expected the GEO to help them to be 
admitted to an educational institution, and 52% to a jbb training pro- 
gram. Respondents were asked about, their participation in educational 
or training programs since tak\ng, the GEO. About 45% had participated 
or were currently enrolled as part- or full-time students. The institu- 
tions respondents most frequently enrolled;in were community colleges^ 
Respondents we re also asked abqut their future plans for participation 
in education. Seventy-five percent stated that they planned toenroll; 
in some kind;of educational program in the future, with "30%: indicating 
a community college; *\ 

This study was limited to educational and employment outcomes. It 
did A nqt. examine participants 1 other goats^and more personal and affec- 
i tive outcomes of passing the GED test, such as increased self-esteem. 
Such outcomes should also be considered in an evaluation of a GEO program. 
However , the results of , the study did 1ndtcate_that many people_ take the 
GED to get a, better job or to qualify for further education or training. 
About half of the respondents actually did achieve these goals as a 
result of passing the GED. 

■ , — — 

. Statewide St udi es ' i 



the most detailed impact study, on a state-wide level was ABE, in >Qftio : 
L A Program Impact Evaluation ^ conducted i n 1977 by Davi d L. Boggs, Terry 
^E^Buss, and Steven M. Yarns 1 1> . ,Th Is st udy was 1 nt ended "to dete rmi ne 
whether the purposes of the Adult Education Act were being achieved in 
Ohio AfeE programs. M The general areas of concern were improveniiBnt of 
occupational status, further assimilation into society, and attainment 
""o£-p^rsonal : goa 1 s. A telephone survey of former ABE students was con- 
ducted three years after they, had enrolled in the program. A representa- 
tive sample, sel ected. according to a multistage random sample design^ 
was drawn from a stratified I sample df_12_ABE prbgbaffis^ Of an estimated 
3,500 former' students (terminated in 1 973-74) , 1 ,200 had valid phone 
hummers or addresses* Interviews we re_ held over a one-month period' in 
1977^ Of the 1 ^200^ only 351 ^ about 21 %* were contacted and Interviewed* 
In addition, a control group of persons eligible for ABE, But who had 
never enrolled, were interviewed. . ° 

] Academic, outcomes of ABE wjere measured by, test results, attainment 
of educational goal 5, and participation in and plans for continuing edu- - 
cation;/: Students 1 beginning and separation grade levels were taken from 
program records.. : The mean reading score gain was 1.75 grade levels; the 
mean math score gain was 3.06 gradfe levels. The mean hours of attendance 
was 113 and the median was _88. t .- ' 

Students werfe asked if they had enrolled in ABE to improve their . ; 
math, ^reading, and/or writing ski] ls^ and to pass the GED, and whether 
thei r goals were met. Over 95% who had wished to improve their academic 
skills felt that they had. Sixty-two percent stated their goal was to 



pass the 6ED test; Forty percent actually did so, • : - 

Interviewees were asked if they had enrolled in ABE to prepare for 
another educational program, and if so,' did the preparation helji. They 
we re also asked if they were currently enrolled in an educational program 
or if they, planned to da so in the future. About 17% of the. respondents 
were currently enrolled in programs such as GED classes, vocatiohal- 
technical training, and college. Nearly 60% said that they planned to 
enroll in some" kind of educational program in the future. Further ABE 
or GED classes were most frequently mentiorted. • . 

This^tudy measgr^ed improvement in economic and .occupational status 
* byasking^whetRer participants had obained t employment, a better job, 
increased income, or increased job security since participat in ABE; 
Sixty-one percent 6f;the participants said that theyfenrblled to obtain 
a job or a .better. job; Over 50% reported^they did s6i Of the inter- * 
viewees who Were emplbyedj about 40% had received promotions since 
enrolling in ABE^ and almost §5% felt that the chances of keeping their 
jobs were betters Thirty-four percent said that participa^ 
had helped them inc^^ the. students^ reported 

change in income, with adjustment for inflation, did not improve thei r 
relative financial status. . - 

One of the stated goals -of the, study was tpsde^ 
students had been "further assimilated into sociefe" Of major con- 
sideration were parent/school relationships. Formefc ABE students were 
asked if they had school -age chi Tdren , attended meetings for parents at 
school , helped children with homework, how many times^per week , whether 
attending meetings and helping-chtldren-had^tncreased since their partici- 
pation in ABE; and if they were now more able to talk to teachers. 

Over 75% of respondents had school -age children, and at least 65% 
said they usually went to school meetings and helped children with home- 
work/' Since coming to ABE, 79% .of the parents said they helpred more with 
homework, 42% said at least 1 , 2, or 3 times a week. Since coming to ABE 
classes, 38% of parents attended meetings at school tnq re often; About 
69%.sa : id they were better able to talk to teachers^and principals since 
ABE* which seems to reveal an increase in self-confidence. The, results 
indicate that ABE ihad a positive effect on parents' involvement in their 
children's education. 

Boggs 1 questionnaire included a variety of questions in regard to 
participation. in social institutions and gene 

Former) students were asked if they used the library used social, services^ 
were involved in community activities more, about thfe same, or less since 
attenji ng ABE. About one thi rd of the respondents indicated that they 
usedyrhe library (30%), anc| social services more* (32%), and were more 
involved in community activities (33%) s i rice ABE. 

Students were also asked if they were, registered to vote, if they 
had voted in 1972 (before or during their ABE class) and in 1976. Voting 
increased by 6% from 1972 to 1976. Of those not voting in 1976, 25.8% 



were. registered to vote. The effect of- ABE on voting behavior was insig- 
nificant.; V ; 

In. terms of students'^ personal development, the Boggs study primarily 
focused, on whether students' personal educational goals had been met. In 
addition, respondents were asked if *they ha,d hoped to attain the personal 
goal of getting a driver's license by participating in ABE. Very few 
indicated thai they had such a goal , so no data were reported on this 
question; f 1 - - . 

Respondents were asked two questions in regard to appljjLai4-on---of i 
academic skills: do you read magazines, book s^jfli^rvewSpapeh% ^ and write 
letters more, 1 ess, or about the safrie since-enrolling in ABE? About 57% 
said that they re^d more, more , 

often. Former students y^j^--^Tso asked ^if studying* and talking to people 
were easier since ABE, antf-about 61% said yes fn bqth areas. When asked 
if they continued friendships made in "ABE, -almost 70% replied aff irmal 

ttVely. ■''•;'".;.■;!■ ' / V v ' 1 ' 
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In general , the result's of the study indicate that students^ educa- 
tional goals are being met in' ABE programs. There is an so some evidence 
of gains in employment* Effects on parents' involvement in their chil- 
dren's schooling seem positive, but th£ actual impart on their children's 
school performance needs further study. Also, more attention is needed 
to changes in self-eoricept and attitudes which affect other outcomes such, 
as community involvement; .. The low response rate of the survey is a prob- 
lem which may be diffi cult to bvercome in any study which attempts td 
measure outcomes over ah extended period of time. - 

Another state-wide study; Evaluation of Adult Baitc Education in "" 
Tennes s e e , was conducted in, 1980 by Paul L. Jones and John R. Petry. This 
study evaluated ABE programs in Tennessee in terms of program gpa]s arid 
objectives, instruction, and s^ 

with^their teachers; Data were also gathered about Students' perceptions^ 
of the outcomes of the ( i r. participation in ABE. 

Studerits' ..perceptions of outcomes were measured by a 26-item instru- 
ment with a Like rt-type scoring- system. . The instruments were sent to a 
sample; pf 80 programs across . the. state. Effch program di rector x was asked 
to ^administer the instrument to 25 students. Thus, the sample was not 
stHctly_rgnddm._' Iaformati on_ was returned f^ 72 programs — an 80% pro- . 
gram response rate. From a potential sample of 2,225, 1 ,623 usable forms 
were bbtained--a response rate of 72.9%. 

the instrumenfc cpntained statements which were intended to measure 

change In M qual i ty of A if e; The statements- were based on * con ce 
from the literature in the field of adult education. "Quality of life" 
was defined: irv terms \of (1 J self-expression, (2) self-concept, (3) family 
life, . life in general , (5j 1 eisurei {6} relationships with others, and 
(7j society. Responses. were ana lyzed according to the characteristics of 
age, sex;; racei level of ^past education,, length of time enrolled in ABE, 
employment status, and income;:, ! ~ ' 



In kenera-1 , the results indicated that participants felt that ABE 
hiad. a positive effect on their livesi Sverall, respondents perceived an 
improvement in each area of the /"quality of life" assessments Males^ 
older adults i and students who. had been in the program for longer periods 
of time tended to give^the most positive responses." -However, £he study . 
was limited '.because the saniple consisted only of students currently par- 
ticipating in ABE. ' . 

is .-ho^surpHsirig that current participants would feel generally 
positive abputVthe outcomes ofthedrparticipat would 
stop attending.^ Data are needed on the perceptions of students who dropped 
out of th^ A3E programs.' Also; the study is deficient because, provides 
no infor^tion~-on"the benefits of ABE for those students who completed 
the program or achieved their personal goals., However^/the research is 
significant because it attempted to determine some of 'the more affective ♦ 
outcomes of* participation in ABE. 

. '~ Per c eptions of Program I mp act :' ABE/6ED -in* Maryland , a 1981 'study 

conducted by Sharon M. Wa Iker, D. Merril 1 I ,£wert, and Gene C. Whaples, was. 
similar in terms of shortcomings. The research was based on personal 
-interyi ews with 1 20 students f rom. t'hree Maryland counties. The iriteryi ews 
wer/e supplemented by group discissions^ .classroom observations and case 
studies. The sampling frame was* developed by, randomly selecting 26 ABE/ • 
GED classes from which five participants were chosen to* be interviewed. 
A^gain., the study was limited because the sample consisted only of students 
currently enrolled in an ABE/GED program. Peopl e who had reached their 
/goals earlier or who dropped out because the program was not meeting thei r 
y needs were not included in the analysis. 1 Also, the study was based on 
students 1 perceptions only, and included no data on long-term outcomes. 

Questions regarding changes in participa nts' lives were grouped 
Into the following categories: changes in economic status, ;attitudinai 
changes, changes in personal relationships, and participation in contin- ' 
ing education. Results indicated that the major change attri buted to. 
participation was a change % in , sel f-concept — 89% of respondents reported * 
"feeling different about themsel ves" as a result of participation in 
ABE/GED programs. .Interviewees also perceived a^gorovement - in basic 
ski lis. . Seventy-six percent felt that thei r readinpjkil Is had improved, 
81% that their writing skills, had improved, and K 90% that their math skills. . 
had improved as a result ,of atten^i ng. ABE/GED classes. 

_ < ^Thjs study did not reveal any; significant economic changes for par- 
ticipants in ABE/GED programs. However, the limitations of the metho-* 
dplogy were recognized in this area. Since t her sample was still involved < 
in classes, changes in economic status. 'may'not have had time to develop. 
Interviewees did perceive their, future employment prospects to be improved. 
Eighty-five percent of those unemployed perceived their chances of finding 1 
a job to be better. / 

In conclusion,, this' study was limited by a~ sample consisting only of , 
currently enrolled students, many of whom hgd participated for. a -short , 
time.,. However, the results do suggest that improved self-concept was a 
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major result of participation, even for those students wh 6 had not ex - 
perienced other, more tangible , changes* : n . ' 

■ v " Local ^Outcomes Studies 

... . * . * • ■ ° >™ " ; : . •■ ' 

Follow-up studies of special progams and projects have also provided 
information on'ihe* outcomes of participation in ABE. One such study was 
done of the effects of participation in the New York State Externa V-tfigh 
School Diploma Program on its graduates. / A questionnai re was ma i Ted to * 
-graduates ten months after they completed the program. As of June 1 978, 
the response to the survey was 60% (387 completed questionnaires). 

Questions were. grouped into the fol lowing categories: learning- 
related activities, job-related .activities, effects on self-concept, and 
improvement of ski 1 Is. THe most positive responses were in the category 
"of effects on self-concept. More than, 8 2% of respondents reported feel- * 
ing more, positive about thei r' abilities as a result of earning a diploma, 
and 94%»reported an increase in self-confidence. Respondents also re-_ 
pprted significant improvement i-ri ..basic and life. skills* A substantial 
number, more than 78%, expressed interest in continuing their learning. - 
Job-Delated, changes were not as significant, although 52. 7%, reported a 
raise in salary. No data were given on the percentage of unemployed . 
graduates who had become employed since receiving their diploma* Vie 
utility of £he findings is limited because the ; re was no data on 
unsuccessful program' participants. j ^ 

• J_ The Texas Adult Performance Level Project r (l 979) also surveyed ^ 
students jto demonstrate prpgram effect Ivenes's. The survey consisted of 
a questionnaire mailed to graduates six months after they received thei r 
diplom^; Ninety graduates; res ponded to the questionn aire. Data oh pop- 

^1^'^^ i ^ s i ,'2f^^m ^ ~ s ^^^^^^^_1_ ^* * s ^ ^ ^ n ^i ^ 5t^^^ ■ i^/g^' ^^^j ' » n given. Again, an 

improvement in self-concept was:the^mdst significant outcome. More* than 
ha]f of the respondents Reported feeling /fa lot more confident in myself 11 
and 29% sajS the£-felt ; "more confident. 11 /Another important outcome was 
that more than 6ne-t hi rd : of the respondents had taken further courses 
after graduation. There was no information on program dropouts* 

A study of outcomes was conducted. ak part of Project F.I. SiT. 
(Functional In-Service Training),; a New Jersey ^tutorial program for 0-5 , 
readers ( Darkenwa Id, ;1^^ of par- 

ticipation 9i a one page questionnai re was compl eted^ 
necessary, by 51 L students. It inc^uded'_questions about the application 
of reading skills, changes in employment status, and 1 changes in self- 
concept. .About 20% of the unemployed respondents found jobs, and 18%* 
got better jobs. ^In regard to' family Mife,' 33% Of parents began td help 
their children with^their homework, 'and 43^ to read to thei r chil- 

dren. About 59% began to read the^newspaper. As * a result of parti cipa- 
tionMn the program, 59% ^elt better about^their skills and abilities, - 
and 61% felt better about themselves in general; 
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(Many "of* these 1 if exchanges may have been facilitated by the close 
pei|tiorishi£ between tutor and pupj.1 , arid may not have been entirely due 
i to improved reading skills. This type of relationship obvi ously cannot 
be4(leveloped Iri most ABE programs, however, for students in this • JDRP 
va]HS|ted literacy program, the data \did reveal substantial positive 
Outcomes; particularly in: the area of| self-esteem. 

• . • .. . / 

* . • t 

Sumrna ry . * 

_ In summary, the past researchjbn the outcomes of participation, in 
'ABE has not yiel ded consistent or conclusive results. However^ many _ 

studies have indicated that the mosfe dramatic change for students was in 

self-eoricept. Gbi rig fcadk to school 

self-image and gain cdrTfidericei in therftselves and i^n their ability to 
deal with other people; Studies also ffound' that- most_ABE participants 
made at least: some gains in basic skills. •_. These gains were particularly 
important because the majority of students reported that- they enrolled 
in ABE to achieve educational goals. A large percentage v of respondents 
in numerous studies reported at- lea$t partial ly^ attaining their personal 
educational goals. \ 

j 0n the whole, the studies did riot repeal notable gains in employment 
for ABE participants; However, /only a small percentage of students re^~ 



ported that their primary reason s^ for en ro|j1 rig were employment-related. * 
There were indications^ ABE as one step in a process 

towards economic L advancement* Many expressed the desire to continue par- 
ticipation in other educational 6i\ training programs.. % 

The quality of much of the research limits the credibility and 
genera lizability of, the findings. ; Few ^ studies^were designed or irnpl e- 
merrteci With enoqgh care to obtain accurate. information' on all important 
changes which could be directly attributed to ABE. Thestudies were also 
h§ridicapped by vqtry low resppnse_ rates and thus by potentially unrepre- 
:sentatiye samples; More research is "needed to identify accurately the 
many outcomes pf part]cipatipn_in ABE for the individual, andto assess 
the impact of ABE^on society as;a whole; However* this research wil 1 be ' 
of little value unless^greater attention ^s given to correcting the basic 
methodological shortcomings noted above; - . 

■ •< « 
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Introduction 

Before describing in detail, how the research was carried out, it is 
important to cpnsider the general 'issue of design alternatives and the 
rationale for the choice made in this respect* 

The ideal design* of course, would have been a fi el ^experiment witfr 
ratidom assignment of adult learners to treatment and control groups; 
Obviously* this was impossible,' if' only because participation in adult * 
education is voluntary and enrollment open-ended* Ap actual, rather than t 
hypothetical option, was' to employ a "matched" control group.design; However, 
in our opinion and that of experts in research methodology (e;g;, Kerlinger, 
1964), matching on age, sex** race* school attainment, etc., is not an adequate 
alternative to random assignment and may even lead to misleading cpnclusions. 
There is simply ho assurance whatever that all relevant; variables are? 
controlled. In the present case, the fact that ABE students voluntarily 
part icipate assures that they differ in a, significant way from any "matched 
; group" that might be constituted. ^ 

An alternative we would have employed, had we the requisite time_and 
money, is the si ngle group with replication design. This design entails 
dpawing two random samples at two different points in time. If the outcome 
f i ndi ngs are similar, they can be attributed with some confidence to 
participation in ABE. Stability of findings oyer time and place indicates, 
for example, that conclusions are unlikely to be confounded by extraneous 
events or ci rcumstahces (e.g. , changes in labor market conditions or 
population demographics). , The design also controls for maturation, which* is 
general 1y considered the most serious threat to internal validity , 
particularly in quasi -experimental research. However, when the subjects or 
respondents are out -of -school adults, it is illogical to expect any 
maturation effects, such as increased knowledge or ability, due to normal 
cognitive development not part of the treatment. Put technical ly, this no- 
treatment expectation for adults (but ^bt for school or college students) is 
no change. Thus, even a single group design without replication, which was 
the option selected given the constraints described above, controls for the 
major threat to internal validity in research with adults that does not 
utilize tests or obtrusive treatments^ 

J ' '"• " • . .. :> - 

Since the purpose of the present study was not to test hypotheses or 
conduct a formal evaluation, most of the validity issues, central to the 
jfradi titinal experimental research paradigm are less Important than they, may 
seem or even totally irrelevant (e.g., regression toward the mean, testing 
effects, reactive treatments, and so on.) What we sought to do, and did do, 
was to obtain factual andattitudinal data from adults concerning their 
experiences as ABE students. The method employed was the traditional . 
sociological survey, yfhus, the technical adequacy of the research should _b£ 
judged oh the basis of criteria utilized by survey researchers rather than 
experimental psychologists. These have to do -mainly with sampling design, * 
response rates, questTohnai re construct idn, respondent recal 1 , inter-rater 
reliability, and the validity of responses to certain types of items* such_ 
as those dealing with sensitive-matters. Subsequent sections of this chapter , 
address these issues separately for each of the two component surveys, 
describing the sampling plans and samples, instrument development, and data 
col lection 'and analysis procedures., 

: :/ ■ ' ' ox 

! ' . ^ -/ ., .I- . ' 19 ■ : ^ 



20 



SanpTirig Design & Procedures: Outcomes & Impact Cbmpbrferit 

*iL s ~ _ — _ — 

In rtev^ Jersey * adult basic ski 1 Is education (termed here ABE )- 
encoSpasse^lal 1 educational programs for ariSlts deficient in the ba'sic 
Skills* intruding ability to speak the English language. No_pfficia1 
distinctions are made between English language instruction (ESI), 
instruction geared to the heeds of the functionally illiterate (commonly 
termed ABEj, and programming for_more advarked students preparing for 
high school completion via the GEETtest or^xhe adult high school i Thus, 
with the exceptions noted below, the study population consisted of al^l 
basic skills students enrolled in publicly supported programs sponsored by 
school districts and community colleges across the stateV Exceptions ' 
included participants in ESt classes (because pr language and cost 
constraints) and those enrolled in^programs for "special I * atypical popula- 
tions, namelyj/ prisoners, the ment ally ill, the mental ly retarded, and the 
aged; The to^al population of ABE students, excluding those, enrol led in 
Est and special_ programs, was 28; 179 in 19§2 (program data ftir_ 1983 .were 
not availabl^at the* start of the study nor when this report was, written,) 
The total number of «BE programs in the state, subtracting 23 serHng only 
ESL and special populations, was 127. 



Sampling Design 

Simple random sampli ng was not possible because a total ji sting of 
the population, includi ng addresses and phon* numbers, was. unavai lable. 
Consequently, the ''probability proportionate to size 11 sampling technique 
(Babble, 1973) was employed to select a random sample proportionate to. 
program (cluster) size. 



In. the first stage of sampling, each cluster (program) is given a * 
chance of selection proportionate to its size (in number of elements). 
Large, clusters have a better chance of selection than small ones. In 
the second stage of sampling, however, the same number of elements 
(respondents) are, chosen from each selected cluster* the effect of 
these two procedures is to equalize the ultimate probabilities of 
selection of all elements, since elements in large clusters stand a 
poorer chance of selection within their cluster than those in small 
clusters, (p. 1 01 ) 



The formula indicating a given element's (student 's) probabi li ty of 
selection using a PPS design follows: 

Element Number of Cluster Size Elements 

Probabi lilty = Clusters x x Selected 

Selected Population Size Per Cluster 

| Cluster Size 

Applying this formula to the present research, the probabi lity of a given 
element (student) being selected was .014. 
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Obviously, to utilize the PPS design, it is .necessary to determine the 
desired sample size and number of programs for the first stage of the 
sampling process (i.e. \ selection of sample programs based on cluster 
size and number of clusters). In the present study ^ ;the_sample size was . 
set at 400 §nd the number of. programs to be selected at 10. The ideals of 
course, is to select the largest possible sample size and as many programs 
as possible. A sample 0^400 distributed oWr 10 programs was judged the 
maximum feasible given the constraints of a small budget and a full-time* 
staff of 6ne. Nonetheless, a sample of 400 was sufficient 'for the study's 
purposes. Among other things, it was more than adequate to permit sub- 
group analyses (e.g*, by age or sex) without reducing the sub-group N's so 
greatly as to jeapordize the validity of findings and conclusions. 

Sampling Procedu re . 

The sample programs were selected by "cluster 
numbers" to every program in accordance with its ABE enrollment 
as appropriate). A total of 704 such cluster numbers were assigned, with 
each number representing 40 studerjts [total N = 28; 160 after rounding.) 
The largest program was assigned 79' cluster 
Finally, from a table of random numbers ,lb^fhre^ 
001 and 704 were selected in order to complete the first stage of the 
sampling procedure. Although the fi rst stage sampling design called for 
selecting 10 programs, 9 were actual ly selected because 6ne program, due 
to its large" size, was selected twice. Double selection does not violate 
the principle of randomness inherent in the PPS method. Of course, unlike 
the other 8 programs/ the students (elements) randomly selected from this 
one total led. 80 instead of 40. . 

Once a program was selected* using the PPS technique^ its director 
was informed of the purpose of the stud^and asked to participate. All 
agreed, thus maintaining the integrity of strict random selection^ For 

each of the ? programs , a ''project liaison i coordinator" was selected to _ r _ 

"assist with element sampling and to provide additional -data on the character 
istics and status of students in the sample (e.g.^ age, sex, monthly 
attendance figures ). The coordinators^^ project -s Advisory 

~Bpard and were paid a token honorarium. Their first task was _tp_ compile 
a list of all non-ESL students who were either "continuers" or who had 
enrol led no later than October 1 , 1983, and had completed 12 hours of . 
instruction by November 15, 1983. Students on the lists of "elfgibles" 
wereassi ghed sequenti al numbe rs and 40 were selected from^aach -program^ 
(80 from it the program selected twice) using a table of randorn numbers . 

i ...... r. J J ' 

The October 1 and 12 hours of instruction criteria require some 
explanation. October 1 was set as the cut-off da€e in order to allow 
approximately seven months for program effects to materialize (outcome data 
were col lected in late April arid ea^ly May). Previous research suggested . 
that this is not only a reasonable time frame, but also "ecologically 
valid-, 1 ' that is* reflective of program ^reality since only aB5tri-2Q^of_, 
ABEpjtudents continue participation from one year to the next (Development 
Associ ates, 1980)." It is important to note, moreover, that seven 'to s< 
eight months represent the mini muni effect parameters. Students enrolled 
between July 1 and September 30, 1983, and carryovers from the preceding 
year (N = 71 or 17.8%), were also included iri the sample. The twelve tfours 



of .Instruction criterion was necessitated by the state!s official 
definition of an ABE .participant as a person enrolled for a mi hi rtiurti of 
* 12 hours in a given fiscal year. . 

Description of Sample Programs . 

Eight of the nine programs were operated by school districts in 
Pate rson, Plainfi eld, Perth Amboy, Milltown, Trenton, Union County (a 
regional district), Jersey City, and Asbury Park. The ninth, situated 
in Hackensack, was sponsored by Bergen County Community College. Eight 
of the v ; state's 17 counties were represented in the samples Program 
locations represented a mix of. large* depressed urban centers (e.g., 
Trenton^ Jersey city i Paterson), small cities with large minority popula- 
tions (e.g., Plainfield, Hackensack, Asbury Park, Perth Ambbyh a rural 
town in the southern part of the .state (Mil [viT.1e)^_and a middle-class 
surburban community (Union) [ocated ami dst other surburban cbmmuhiti ess 
Total "el i gible" ABE enrol lees ranged from a low of 143 in Mill vi He to a 
high of 1,827 in Paterson. 

Some of the programs could Be characterized as "adult learning centers , 11 
emphasizing individual instruction rather classes^ Others were 

more school-like^ stressing the traditiq 
i nstruction. Although large, urban* p 

they enroll more students^ overall the sample seemed to reflect the genera] 
make-up of ABE in the state of New Jersey, both geographical 1y and in 
respect to program characteristics. , % , 

■ Sampling Design & Procedures : Cost-Benefit Component 

In order to ascertain the benefits derived from obtaining a hi^gfi 

school credential y it was necessary to select a stratified sample represen- 
tative of both GEO andVadult high school graduates. These alternative 
routes to obtaining a diploma are very different.' The GED,- of course, is 
simply a. test of "equivalency " normed on high school seniors^ The adult 
high school, in contrast, is something like a secondary-level external 
dagree program. Students can earn credit for military and work experience, . 
apprenticeship training, courses provided by employers, proprietary., schools, " 
community colleges, etc., skill assessments and tests?, and through 
independent study or attending classes in traditional high^s.chool subjects. 
Compared' to GEO students, adult high school students are often older, -more — : — 
"settled"- community residents. They receive a regular, local diploma 
rather than a state high school equivalency certificate. 

A sample size of 500 was determined to be the maximum passible given 
available financial resources. It was partitioned to, reflect the approximate^ 
ratio of GED 'to adult high school graduates in 1982: 300 GEO graduates 
arid 200 adult high school graduates. It should be noted that only those ; 
fGED graduates who prepared for the test by participating in publicly supported 
i nstructional programs were, included in the study population. 

The 300 GED studerits^erd_selected_using 
jjjjL_jiep4aeemerrtr; — -^hir~5amp I ] ng~frame~ consi sted of all GEO graduates 
(excluding those who took the Spanish form of the test) who participated 
in basic skills programs and passed the test between January 1, and 
April 31 , 1982. A four-mbrith frame ^was- deliberately chosen to control for 
seasonal fluctuations in test-taker characteristics. These time paramters 



allowed for roughly 14 to 18_m6ntHs for , "credential" arid other effects to 
materialize. The time fra^l^a! so minimized two common and s^nous problems 
associ atecTwith longer ftfuow-up intervals: poor recall and Jbw response 
• rate due to geographical ^mdbi lity. - 

" A computerized 1i sting_6f* al 1 GEE) graduates for the period January 
through April, 1982, was obtained from^the state education_department ^ 
Graduates who had not particigated^i n publicly funded instructional pro^^ 
were identified on- the printqut and; deleted from the frame'. All ; others 
(N = 677) were assigned sequentiaT numbers, and 300 were then selected, 
using a table. of random numbers.* >* ♦ 

Simple random' sampling was not employed to seject^Jhe sub-sample of 
adult high school graduates because a listing of .the total I population could : 
not be obtained. It was necessiary, therefore, to utilize the original nfne 
programs randomly selected by the PPS method iri order to draw the adult high * ■« 
school sUb-sample. Five of these programs (Asbury Park, Patersqn, Perth . . 
Amboy, Plainfield, and Union County Regional ) operated adult high schools and 
al 1 agreed "to supply lists of their 1982 graduates. The' five lists were 
pooled into a master list of 604 graduates; the 604 were assigned sequential 
numbers , and 200 were selected for the sample, using a table of random numbers . 

Instrumentation: > Outcomes & Impact Component . 

To develop the "Adult Education Fol low Up Survey" (see Appendix A), the 
first task was to identify relevant outcome measures . This was accomplished 
as follows. First, prior outcome studies were scrutinized to determine the 
relevance, utility, and technical adequacy of their outtome variables and 
items. This review resulted in our di scardi ng certain variables (e.g., regis- 
tering to vote) and gi vi ng careful cohsi deration to others (e.g.,. affective _ 
out comes \ s uch as enh^ ng^ 
ABE teachers and administrators was convened. Using^the brainstorming 
technique, the group generated a list of outcome measures that met the fol lowing 
criteria: (1 ) Si gnif i cance,- i .e. , import for students and society; 

(2) Relevance, i .e., logical connection to ABE curriculum practices and 

priorities in New Jersey (APL "competencies" are not ,a New- Jersey priority);, 



* Subsequent to drawing the GSD sample it was di scovered that the pro- 
portion of graduates who indicated they had prepared for the test through 
participation in publicly supported programs (14%) departed radically from 
national statistics pertaining to such preparation. A national follow-up 
study of GEO candidates (Maliz.io and Whitney, 1980) found that 46% had 
attended "classes i" A similar national study oc GED graduates (Cervero, 1983) 
found that 51% had participated in classroom <(nstruction.-- Interviews with 
testing officials clarified reasons for u n de r -hepo ^i nQj J* >9?> providing the 
♦ information is optional , some students view the question as intrusive, an d; _ / 
above all , students fear that, should they not pass, others wil V Jcnow of thei r / 
.failure. State officials estimated that preparation via basic skills * /. 

programs was at least as prevalent i n New Jersey as in other states. 
Consequently, for certain calculations' in Chapter 4, the true population of 
interest was estimated at 48% of those who passed the test (the 48% figure 
is the average of the two national statistics noted above) . 
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and (3) Application., i.e.* utilization i of skills arid tangible changes 
in life ci rcumstarices were deemed more impbrtarit s thari attitudes or . ,_ 
opinions. The resulting list bf outcomes, Which reflected a consensus, of _ 
the tota[ group «and the researchers, was then- categorized into the following 

general* domai ris: work-related, family-related, community or societal- 

related, personal growth-trelated, and academic. The final step in identify- 
ing outcome vaHables involved a thorough review~by the project's Advisory 
Board of the domains and, _measures previously _\deriti £ f iedi, The Board (also \ v 
comprised of practicing prof essional s ^concurred with the choices previously 
made, suggested some minor-changes, and helped^the researchers prioritize 
the final list. ~ • ; 

The constructionof the questionnai re involved a meticul bus process 
cff devel I opi ng, fi&l d-testing, and revising success j ye drafts. Eaclvbf 

'three preliminary drafts, as well as the final- version, was field-tested 
with groups of about ten ABE, students Enrolled in for 

• the sample. • Special I attention was given to the distinctive technical 
problems of constructing a questionnaire to be administered orally over the 
telephone. These included I c*teurr~Tratural wording of items, smqoth__ 
transitions from item to item and section to section, clear formatti ng^as 
an aid to the, i nteryi ewers ,. and careful selection of probes for open-ended 
items. ' m ' \ ■ > 

A distinctive feature of the questionnaire wasthe inclusion of a' 
large number of open-ended it'ems. Previous, research has relied almost 
solely on closed, fixed-answer questions that inour view raise serious 
doubts about th"e meani ngfulness and validity of the responses. We agree 
totally with Labaw's (1980) position on this matter: 

— - ~i->Jhese- types- of -questions^ — - 
thorough understand! ng of complex issues and topics.... Free 
respon^e^or. opfen-ended questions .are the only way the ♦ . "\ . 
researcher can give the respondent the. opportunity to "haye his 
own say...." The mai n_p_urpose of an interview, the most/ \ 
important goal of the enti re sur^y-prof^ri^, is to let the - 
respondent have his say, to let him. teVl tTie^^ what he 

i means,' >pot vice versa. If we do not let the respond en t^h a ve . 
t; his say, why- bother to interview him^afc al l? (p. 133) - 



- \ 



Labaw goes on to note that the principal drawbacks of open-ended 
questions are merely logistical, namely, the time and the professional 
expertise, arid thus money,: requi red to code open-ended answers. JMerks * 
and other non-experts simply cannot do the job. We addressed this Tissue 
squarely (albeit with some personal grief): all open.rended questions 
were coded by the protfect"^ director and co-director, bbt.h of whom have^ 
-experience and expertise in ABE arid inductive coding, techniques. ~ 

There is little point in describing the content and formay of^the 
questionnai re, which is reproduced in Appendix A, other than tp note that 
it included items riot directly related to outcomes, but judge d of p otential 
importance for predicting or. explaining outcomes. Thus, for example* the 
i nstrument includes items - on Student expectations of the "course," problems 
they might have experienced/ arid whefher or.not enrollment was "triggered by 
a specific life-event. 
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Rel i ability and 



Validity refers to whether or not a measure (t^plcaijy a scale or test) 
actually measures what it purports to measure. r in survey research, discrete, 
self-report items are, 1 n general , assumed ttf be valid *as w ; ell as reliable. 

If an item required respondents. to report factual data (such as age, sex, 

obtaining a ar^pferitial )„ the response is se^f -evidently valid under most but 
not all cinjlfmstanc^. One such circumstance is/poor recal 1 , which Is mainly 
a function/of elapsed time* between an event, or experience and the posing of 
the quest/oh. We found no evidence that this was a problem i n the.pre-tests 
of the quesyiWiai re. Moreover^, one would hot expect recal 1 tb be! a problem • * 
' gi vefl r ^the i,, Si gnyN<aflce. to the respondents of parti ci pat ion in /AB E- J and the 
relati v^^-lshort-el^sed time between experi ences 6 r events and da 1 3 p o 1 , 1 e ct i o n . 

.. J-*- ^ .■ \ • • ' _ / - \ : -_ - - - 

The validity of responses to sensiti ye questions is, as/noted, problematical 

Innocuous phrasing (e.g.* "Are you still attending?" instead of "Didl, you drop < : 

but?") was employed to deal with the J^ew sensitive questions that ,ha.8;lf o be 

asked. One question (£26) posed spell al difficulties because of its -c^ 

sensitivity/ at Jeast for some people. In effect* it asked if the respondent 

bad been on wel fare* Final ly, the item was re-worded to mi^nimize its stigma 

and eliminate the offensive word "Welfare." /Not a single respondent refusedStb 

answer the final version of 'this, question. The itemalhi ng threat to yal rdi tx - fs ; 

theitendency for respondents to give the "expected" or "socially desirable" *v '•:>* 

answers tgipcertain kinds of t questions . Examples j (though hardly blatant) might : 

b'e questions T2a, "Do you feel you are doing your job better?," or 22a, "Do you 

help the children with their schoolwprk more than you used to?" There is no 

way to know for sure if, or to what extent, respondents 'are less than candid in 

answering such questions.- However, we* do know~that none of the questions was 

ext r emel y s u s cep t i b 1 e to this sort of bias (e.g., similar to asking "Do you 

believe- i n Democracy ?™)-ahd that .nearly^ to the 

inter viewers an attitude of wil li ng cooperation, seriousness, arid~ca~ndor^ — 



Embedded Scales. The questionnai re contained two embedded scales, one . 
termed PROBDEX ?Q.6 )~and the other KIDDEX (Q. 22a to 22e). The fi rst contained ; 
five items concerning, "problems adults often experi ence in goi ng to cl asses ." , ; . 
Inter-item correlations were modest, ranging ..from .04 to .34 .with a mean™, of -.H . 
Given these correlations, it is not 'surprising that the alpha reli ability cot 
efficient for'the PROBDEX scale was°>e1atrvely TbW ; (.39 for 5 items/ .40 with 
item #4. deleted).,. A principal components factor analysis (with varimax rotation) 
suggested that PROBDEX measures two constructs. ' La ck^^P^pr ogress toward goal s 
and lack of help or attention in class loaded ^significantly on one factor, 
whi le the second consisted of one significant item: "Trouble "attending class 
due to job or family responsibilities ." The fl-fcSt factor, might be label led 
"academic problems," and the •secotid "situational deterrents to attendance." 
Although 1 ow, a reliability of .40 does hot. preclude the use of PROBDEX, as a 
^Triable in exploratory analyses. v \ 

3^fhe KIDDEX scale. {5;items);was designed to measure positive, changes .in ■ 
parent and child behaviors related to school activities and performance. ^ - 
Inter-rtem correlations ranged from .20 to .54 with a, mean of .37. The alpha 
reliability co-efficient of .75 was more than adequate for, the purposes of this 
study. A pri nci pal components factor analysis resulted i n a single factor./ ; 
Al V items but one exhibited hi yh factor loadings (.65 to .72). _The exception, 
not surprisingly, was the last item* "Have you become, more i nvofved with the .: 
school ... Its factor loading was a moderate >35. * 
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Inductive .Coding 



As noted above* th* open-ended questions were truly open Response; 
categories were hot est Dli'she^i prt^r"'1J0.- data .col lection^: To "allow 
respondents to have th - say " requi red that all . open-eniied questions, be , _ 
coded i nducti vely , usi ny the" respondents 1 answers to generate the variables. 

"The codi ng process invol ved the following activities. First, a 
random sample of 60 completed quest ionnai res was dravjn to provide; the raw 
data. Next, for each open-ended question* jail 60 answers were listed on a 
chalk board (for repeat answers, of which there were many, the fi^st was . ^ 
listed, and the repeats tal lied. by checkmarks next to it). Following the ;;:r 
listi ng of the initi al responses", those with very low frequencies or that 
were bizzare or inappropriate,, were assigned to a catcfi-al^l "other'V category. 
Fol lowing this initial "clean-up," appropriate or credible responses 
provided by more than a handful of respondents were retained. Next, . 
semantical 1y identical or conceptually similar responses (e.g. ^_"f eel , 
better about myself," "have, more self-confidence,", "gained ; self -respect " ■ 
were cbllapsedintb a single variable or category, in this case "Self r 
Confide pc e /E s t eem . " F i n a 11 y , each retained .category was defined as a 4 
variable and assigned a numerical digit for data analysis purposes . 

• Once the inductive coding was completed, a code book was constructed 
that set forth not only the fi nal coded variables arid the digits assigned 
to^each; but also examples of responses subsumed under the broader code . 
category. For Example, the vari able "Family Change" as an event triggering 
enrollment was listed as "2 -FAMILY CHANGE (divorce, baby, marriage, death* 
kids enter school, empty nest U u This* was extremely important in ensuring 
uniformity in the coding process in its final stage as described below. 

-^^^The fj-nal stage required the two coders (who were senior researchers) 

to read the trai^nis!^ ^ 

them for key-punchlng foil owijig'the scheme set forth in the code book." To 
resolve any proteins of. interpretation, the coders worked jointly for 
several hoursj each checking out ( problems or questions with the other until 
both were satisfied that consensus^ high. -The process 

resulted in minor changes in the codebook to clarify certain vari ables . . 
and their interpretation. Fol lowing this initial "debugging" phase, the 
coders worked independently. for a total of more than 30 hours ^yAfter all 
codi ng had been completed, i nter-rater reliability was detenrj^ned by having 
each coder independently code a random sample of questionnaires previously, 
ctfded by the other. The co-effici^ was. .90* 

^hi^ch is\ remarfeably-h-igh-by any standard. 

f^r Instrumentation : Costs -and Benefits Component ^ -.. , 

■ /Response rates to self-administered, mailed questionnaires are almost 
always 1 ow (Kerlinger, .1 964). They \ -have been especially low in follow-up.; 
studies of GED. graduates. Cervero (1983)i.for example, reported an adjusted 
response rate of 29% in a follow-up of GED graduates who had previously 
/ agreed to participate in the study. Almost surely, a major reason for such 7 
a dismal return rate. was the fact that Ceryero's questionnai re was four pages 
l in length. To t ry to maximize j:he response rate, it wa| decided to Hmit-j 
the benefits questionnaire; Ititled "Adult Education Study^ sjse Appendix B)> 
to a single sheet with'-questions printed : on- both sides. f 

' ' ..' ' ' . ' -.J/::: .'V.,' ■ I ■ ; , . : . ' \: - 7. . 
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The benefits quest Vonnaire^mpfjasi zed tangible outcomes related to . . • 
employment, i ncome, and public assistance^ These econprni^ variables w;ere 
deemed particularly important because pLthei^presunied relatron?h3 p. tp 
obtaining a high school credential . Obviously, however, a cost-benefit; 
analysis has to take into account potenti al^benefits of a, non-economic or 
human capital investment nature- Thus, following the "tegonzation of 
benefits described in Chapter 4, items on participation in further^ education 
and training, academic stalls improvement, self-esteem, and several other 
key outcome variables identified, in the process of developing the initial 
telephone questionnaire were 'included in the instrument. Drafts of the 
benefits questionnaire were subjected to the usual process of trial and 
revision prior to formuTSting the final version. Two forms of the final . 
version were produced: one for GED graduates and one for adult high school 
graduates. They were identical except that references to^the, GED. were 
deleted from one and to the adult high school from the other. No instruments 
were used- to collect cOs#'data. . Sources of cost data and methods of cost 
analysis (aid fo.rmfflas and various ^algorithms) are described in Chapter <K 

- ■ Data Collection: Outcomes & Impact Component 

The data were collected by telephone interviews, a method increasingly 
utilized by survey researchers. Telephone interviews, J ike personal 
interviews, have many advantages over self -administered questionnaires. . 
.Most important perhaps is that the interviewer canr if -Hf essary*' clanfy ;; ■ 
questions and use probes* thus securing more complete and accurate^data. in 
regard to the ouality of data, Bradurn and Sudman (1981, p. 13) concluded 
that "there do 'not appear to be any meaningful . difference s in response . 
bias between telephone and face-to-face interviews except that... cooperation 
[in their comparative study of the two methods! was highest . by telephone. . • 
Another important advantage of telephone interviewing is low cost, ^especi ally 
in comparison with face-to-face interviewing. Telephone surveys also _ 
tend to yield higher response rates, especially compared to mailed question- 
naires. A :di sadvantage-of. til ep hone surveys is that not every housuhol d 
has a telephone. •• ' ~~~ ~~~r~~ — ^ — * • .-\. v - 

Interview Procedures , ' * " • ' : 

• Prior to actual data collection, the four interviewers (all graduate 
students in adult education) were briefed and trained by* senior project 
staff. The main sources consulted on telephone interviewing techniques were 
Surveys by Telephone (Groves andKahn, 1979) and Asking Questions (Sudman 
al^rTdburn, 1§82). After a review of this matsrial , each interviewer .;.;, 
conducted several pilot interviews with. ABE students who Were not. part of . 
the study sample. Problems encountered were discussed and resolved, during . 
three, three-hour training sessions. Most were merely procedural, for \- 
example, handli ng smoothly, complex "skip to" questions. Reviewing the 
logic behind each "skip to" question and additional practice resolved the 
initial difficulties^— ;, * ; 

Interviewers were given hatches of questionnaires with the following 
information filled in on a cover, sheet (the "Student Follow-Up Form" described 
bel ow) and the first page of the questionnaire: respondent s name and 
telephone' number, program name and location, respondent -s age and sex^ 
(secured from program records), and the names, addresses and telephone 
numbers of two people identified by the respondent as likely to knew how 
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we can get in touch with you if you move" (obtained from the "Student 
Follow -Up F orm"); Interviewers were instructed to write answers yerbatm / 
in pencil duri ng the i ntervi ew and then; immediately following the interview, 
to revi ew each answer for accuracy, clarity and completeness, and tqjmake 
any necessary revisions .__If ^an answer seemed to require some sort of " 

, explanation or i nterpretation, they were instructed to provide^ it • Final ly i 
the interviewers provided the following information on the first page of 
the questionnaire: his or her name, date of interview, ...start """time and 

\ finish time; Spot checks^of completed questionnaires were conducted 

periodical ly to ensure that the interviewers were following instructions; 

the majority 1 of interviews were ^completed after one or two attempts; 
However, interviewers were instructed to make as many attempts as necessary; 
(hot the usual two Or three), in order to contact the respondent.. The - * 
number of attempts ranged from a low of one to a high of 22 (mean = 2.9, 
median- 2). The duration of the interviews ranged from 8 to 44 minutes, 
with a mean of 14.5. The bulk were completed in April', 1 983 , although 
some (those difficult to contact) were completed in May. All completed _ 
questionrtai res were reviewed for coding errors (i .&•»■ errors for those 
items that were i n fixed-answer format and pre-coded on the instrument). 

Additional data were collected, using standardized reporting forms, 
by the nine local program coordinators.. One, such form, referred to above,"* : 
Was the "Student Follow-Up, Form" (see Appendix C) which asked for names and 
telephone numbers of two persons who "will probably know how we can get in 
touch with you if you, move." (This informatlpn proved invaluable in 
. /locating many students in the sample who had moved — some interviews were 
completed by phone calls to Florida, California, and Other distant places). 
The local coordinators explained the need "to keep in touch" with our students," 
administered the form to every student in the sample (or, , if that -seemed '" 
awkward, to all students in a class), and returned the completed forms to 
Rutgers. In addition, the local coordinators provided the following data on 
every student in the sample: sex, age, race, level (four reading ability 
categories based on in-take assessments), and total hours of class attendance 
by month for, the period October through March. 

Jwo^bunjJ red ni nety -f ou r interviews, were completed out of a total 

sample of 400 for an unad justed -response The f ol 1 owijjg table 

presents a breakdown of reasons for the 106 ribri-cbfijileti^ : 
_ ■_ • '_ . • ■ _ 

Of the 106 non -respondents, a total of 10 (6 refusals' arid 4 unable to 
: contact) were valid cases; that is* it was hot impossible, at least hypo-, 
thetically, to secure completed interviews from them. The adjusted response 
rate, therefore, was 390/400 or 97%. Even the "unadjusted r*te of 74% is : 
extremely high for a time-lagged survey of low socio-economic status adults.'. 
It. was far higher than that achieved *by any other adult education follow-up • 
study. The adjusted response rate* (the figure typical ly reported by survey 
researchers) is extraordinarily high by any standard. 

Despite a very high completion rate, there remained the possibility 
that. the findings could be biased due. to differences between respondents 
arid those who could riot be contacted. . Consequently, the two groups were 
statistical ly compared on the following characteristics: sex, race, reading 
level at entry, age, and mean number of hours of attendance by month. No 
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Table 3 - 1 




Reasons 


for Non-Completion 




Reason 




Lj — ; , ; — 

• ■,' . 

Percent* 


Refusal 


6 


1.5 


Deceased * 


2 ; 


, 0.5 , 


Hospitalized 






Moved 


15 


" - 3.8 ■: •"' • • 


Unlisted Number . 


18 


4.5 . • ; 


No Phong 


44 


11.0 


Disconnected Phone 


■ |3 , 


3.3 - ... 


Never Able to Contact 


4 





*Based on a total N of 400 



differences we rep found for sex* race and- reading level. However, respondents 
Were somewhat older than non-respondents (t - 4.2*, p = r.001 ) . The nieart ' 
age of the* former was' 30, the Tatter 25. Moreover, although differences 

y in hours of attendance were found for October through December, respondents 1 
x attendance rates - (in hours ) were significantly higher for the period' 
• January through March (t-test p's ranging from .03 to -.001 ). . The age "1 .<-: 
difference may have been due to greater mobi 1 ity among younger adults, 
although this is merely a conjecture.' The .differences in attendance rates/ - 
reflect "situational 11 factors (death, hospitalization, moving away) and, j ... 

— probably as _wel 1 , _a decline i n moti vation , among other "uncontactables 11 *j 
With this passage of ~ time. If this is sb,_:and because very young ABE students 
tend to be less motivated and more dropout-prone than their older counters 
parts (Smith, 19.84 ), it is probable that the findings are slightly biased 
toward positive or desirable opinions and outcomes. \. 

Data Col lection: Cost-Benefit Component | . 

As' noted previously, follow-up data on «GED arid adult high school 
graduates were obtained by means of separate, one-page mailed question- 
naires. * The questionnaires, including pre-addressed, stamped return 
. • envelopes, were mailed i n June with two follow-up mailings at 

approximately ten-day intervals. The second arid third mailings included 
a revised cover letter arid an additional copy of the questionnaire. 
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. . - Data Analysis 




Stafttjairq Errors f 

In order to generalize from sample" to -population Proportions, it js^elpful 
to know how far off sample estimates are likely to be. The statistic that 

things PIl, thi nalnitude of the standard error of ■ .-.proportion Is largely a 
function of sample size; 



For the cost-benefit component of this study two samples were drawn, one 
of GEO graSuate and the other of adult high school graduates Fortunately 
an appropriate sampling frame of GEO gr ^ya.t^^as- aval l.Jble ..to pjwt M | 

For the adult high school graduates, no comparable (i.e., representative, 

school data was computed as + 5%. . . 

The sample for the telephone survey (n = 294), as jr^W^"^? '^jf 

grossly understate the true standard error. . .. -s . . . .f , 
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/As described previously;- all completed questionnai res were reviewed in^ 
coding errors corrected by the senior^ researchers; The raw data were -then 
entered onto IBM code sheets, keypunched and verified; As a final step in } 
data preparation, a listing of -individual cases was generated by computer * 
" >*n f order to identify and correct mechanical errors related to keypunching, 
coding and card order. . . • * 

Stati sti cal Treatment g 

f » 
With a few, excep tions, the data preisented in this report were analyzed 
using simple descripti ve statistics, ..usual ly percentage distributions and, 
occasionally, means and -related measures of central tendency. In Chapter 4, 
t^ and chi square tests were employed to determine if there were statistically 
significant differences, in benefits reported ^by GED^and AHS graduates; The 
criterion for statistical significance, was p >= TOTTI 

Correl ational; and ordinary least squares multiple regression procedures 
were. Used to explore relationships between-ba^ ground variables (such as 
total hours of class attendance, age., sex and reading level) and selected 
outcome measures. Surprisingly, these analyses proved to be of limited 
Utility 1 n pjedi cti n<j the outcomes of participation. In the few instances > 
where multiple regression yielded meaningful insights, the findi ngs' are 
; . briefly noted. v ■ ; ' s 
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CHAPTER IV- 



OF DIPLOMA TARGETEP PR0GR4MS* . *\ 

This chapter provides an analysis of the costs and benefits of 
publicly funded, diploma-target^ addlt basic skills education 
programs in New Jersey. The fi r*t section provides descriptions of 
these programs and ?n overview of the design of the cost-benefit -study. 
The second focuses on the cost ^nct .particlpant data. Recommendations 
based on the analysis of the co£t data are presented next^ The fourth 
section presents the analysis of the benefits of ■ the program. The ;v ; 
overall findings, conclusions and recommendations of the cost and benefit 
analyse? conclude the chapter. - 

State-Funded Adult Basle Skills Programs in New Jersey 

The focus of this cost-benefit analysts is New Jersey's state- 1 
funded adult basic- skills education programs which are targeted at 
preparing adults who .either wish ta receive a Heal Mgh school diploma 
or a High Sch'ool Equivalency Diploma by taking the Test of General 
Educational Development (GEO ) . It does not include an analysis of 
general adult education. The S£*te of New Jersey provides funding for 
diploma-targeted .adult >bssic skil Is education phQgratns> through three 
separate program funding source^: (1) the Adult High School {formerly 
known as the Accredited Evening High School ), (2) the Adult Literacy 
Program, and (3) the High School Equivalency Program, 

The Adult High School is targeted at adultv who wish to obtain a 
: regular local high school- diplopia . State support: for. this program is _ 
provided through the general K-1£ v educati on equalization and minimum aid 
school finance formulas. Adult ,Pigh school students are counted on ^ 

September 30 of each year and this figure is us*d to calculate -state 

ai'd^foT^h^roniowrrig "'T1"sc5Tlfpf^^thT same runner as ~ts~dpnejfor^he- 
■ K-l 2 student population. Th^i/lsi on of Adult Education within the New 
Jersey Department of Education *s responsible tkr approving the local 
districts 4 adult high -schools. State aid to th* districts approved 
programs is calculated by the Division of Finale of the New Jersey 
Department of. Education using the school finance formufas. 

The Adult Literacy arid Hi_gp School Equivalency programs are targeted 
at adults who, at least eventually, wish to prepare far the Test of 
General Educational Development (GEO), Depending on the needs of the 
. learner, instruction may focus 0r\ any combination of the four areas of 

reading, mathematics, life coping skills, and eflpl oy abi lity skills. 

Distribution of state support to local districts is based on evaluation 
by the Division of Adult Education of annual Icrtai district aplications. 
The Division's evaluation takes i nto account th* availability^ to local 
districts of federal basic skills funds in." order to majtltnlze the use of 
available state funds. The Division ijsss the State Adult Literacy and 
High School Equi valency funds tt) provide support for local basic skills 
programming in English or, to. the extent necessary, in the native language 
of the adult learner. Thus, x th£ Division* categorizes its basic skil ls 



*The cost, analysis sections of this chapter weN researched and 
written by Rf Stuart Marshal 1 

\ - * 
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programs as (1 ) English Basic SR11ls and (2) Bijingual English. as. a Second 
Language. Also* for purposes of program management, basic skills programs 
for adults are organized into four levels according to reading proficiency: 

_ _ r. '_ 

i Level I: 0 to 3rd grade reading level . 

Level II: 4 to 6th grade reading level 

; bevel III: 7 to 8th grade reading level 

I tev^l IV: 9 to 13th grade reading level 

i The Cost ^ Benefit-Ana lysis Of The Program 

The primary purpose, of undertaking a cost-benefit analysis of New - 

Jersey's Stjate-funded, diploma-targeted adult basic ski lis 'education 
programs was to answer the question of whether, the beneficial effects of 
the programs outweigh the costs. Theoretical ly, in such studies both the 
cost and benefits of the programs are oppressed in terms of monetary values 
so that they can be compared (Levin, 1981, p. 19)/ Further, under ideal 
conditions, jthe appropriate procedure in comparing benefits arid costs, is to 
calculate thg program's "net present value. 11 ' That is, all costs arid 
benefits would be adjusted to reflect their. worth 1n the current period 
(Cohn,; 1979, jp. 97), , . 

In practice, 1 1 1s often difficulty some might say impossible, to ; 
place a monetja ry value on the wide array of. benefits derived' from programs 
such as adult | basic ski lis. For, exampley brie of the potential benefits 
of these programs lies ill a greater likelihood that participants Will 
encourage school performance among .thei r own children. * Th # 1s benefit is 
difficult to measure in monetary terms because it 1s indirect* affecting 
the participants 1 children, arid because 'it might have further. intergenera- 
tional consequences. These problems are formidable, but should not i nhi'bit 
attempts to compare the costs aridberief its of these programs* The 
analytical framework of cost-benefit analysis is* tri itself* an important 
tool for state policymakers • This framework provides for the systematic 
identification of both program costs. arid benefits in order to aid policy" 
makers -to better* assess the desirability of programs^ Even if some* of * 
the benefits mu^t simply be identified without a monetary value*, knowable 
costs arid quantifiable benefits- can be compared arid thereby indicate the 
value that one would need to place on the uriquarittfi a|)le^benef its sin order 
to "bring the program" to a desirable position in the view of a particular 
" icymaker. ■ ; 



The Cost Analysis ; ^ V e 

\ • ' : y 

In this analyses, the generic term "cost^" is osed to mean "expenditure" 
because the term "cost," according to Chambers and Parish (1982a) is 
defined as: ; 

Jthe minimum expenditure required to 
/achieve some goal or s tandard of 
service or to acquire some welT~ 
defined commodity or 'service (pslj 



and the term "expenditure 11 is defined as: 



the actual outlay for some^good or 
service (p.?) : 



The key to understanding the difference between, expenditure and cost is / 
recognition that a costis based oil a precise definition of a goal or / 
standard of service while. an expenditure is not. The state_ of :New Jersey t 
has not based its monetary outlays fordiploma-targeted basic skills 
programs oh a defined standard of service. State budget allocations for j 
these programs have been based on the availability of funds in competition 
with other state funding heeds. This is the usual, basis for state , 
allocation of funds, but it should be rioted because we cannot tftfer; from 
the "expenditure" data whether these programs should "cost" more or less. 

In addition, it should be noted that expenditures at one* level of ; 
government are revenue atanbther level. Local districts receive as 
revenue the state expenditures for these- programs arid then make independent 
local expenditure decisions. For example? because the state of New 
Jersey does not mandate that revenue generated by adult high, school 
students be spent solely on adult high school, programs, state expenditures 
may in fact be more than what, is actual ly spent by the Ideal districts 
on adult high school programs^ Therefore* in addition. to the ident*f|ca- ^ 
tion of state expenditures for these programs, data will be presented ion 
the extent to which this revenue to the local district is spent on these 
programs. The review of local expenditures will be limited to ah 
examination of reports on actual expenditures for these programs made by 

local districts to the state. * ^ 

i> * ■ ... 

" 7~ With these clarifications, the aim of the cost analysis is to 
examine New Jersey state expenditures for diploma-targeted adult basic 
skills programs for fiscal year 19S1-82 (latest year. for which data were., 
available). State expenditures for each program will . be identified in 
total and on a per-participant basisi Based oh local district reports, 
local expenditures for each program will also be identified iri total and 
on a per-participarit basis. The results and further discussion of the 
cost analysis are presented subsequently. 

The> Benefit Analysis , , . . * 

The benefit analysis of the New Jersey state-funded diploma-targeted 
adult basic skills programs has as its basehuman capital theory. The 
basic premise of human capital theory } s that investment in education 
will result in higher worker productivity and this- higher worker productivity 
will be rewarded tn the labor market with higher earnings (Cohn, .1979, p. 29). 
As stated by Cohn: — 

Th'e basic premise of the human capital approach ri,< 
is that variations in labor -income are due^ in * im- 
part, to differences in labor quality Vr\ terms , 
.of human. capital acquired by the workers. _.. 
' Therefore, if one wishes to reduce inctjme inequality, 
one method ti> achieve this would be to reduce 
inequality 1n the investments people make in human 
capita! (health, education, on the job training, 
" other vocational training^ _etc^ J'sss sTfits Ehuman : 
capital approach] is consistent with "orthodox" 
economic theory better_known as marginal < fc . 

productivity theory, which argues that wages are 
determined, according to a worker's marginal* 
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contribution to revenues^ of the_firm, implying 
that more productive workers will be paid more, - 
other things £qBa1 ** (p. 28} - 

A -simple description of the process is illustrated in Figure 4.1 , where 
A'' (investments in human capital ) lead to B (higher productivity of 
workers) which in turn causes G (higher\earrii rigs). 



Investment 




Higher 


in 




Productivity 


Education 




(A) 


(B) 




Figure 4.1 The Human Capital Approach : * : 

While Cohn recognizes rival theories to the human capital view, he 
concludes that the evidence in. support of /it is more than sufficient tp 
merit concentrated attention on this approach (Cohn, 1979, p. 32). 



i Using human capital theory as a base, one would hypothesize that 
adults who participate in these diploma -targeted basic skills "programs 
will become more proactive and, "hence, will have higher earnings than 
they would have if they had not participated, other things being equal. 
This increased /productivity effect could also manifest Itself 1n more 
hours worked per week, Increased proportion of weeks worked per year, and 
ove ral T great e r stab il 1 ty of empl oyment 1n addition to higher wage rates 
and higher earni ngs o 



. In order to get a broader view of the potential/benef its of these 
programs, a review of recent cost-benefit studies of basic skills programs 
for adults was conducted and a panel of New Jersey adult educators was 
consulted concerning a list of potential benefit's developed from the 
•literature review. The current study draws heavily from the recent 
cost-benefit study of the nat1onal_Jeb' Corps program completed by 
Mathematica Policy Research, Inc., 1n 1980. One of the central purposes 
of the Job Corps program was improvement of the basic skills of young 
adirlts '(Mathematica Policy Research, Inc.', 1980, p. 7). 

Chart '">-l provides a summary of hypotheses of program benefits to 
participants- which were generated from the literature survey and panel 
review. Following the Mathematica study, these benefits are arranged 
into three categories of potential effects: (1) employment and earnings, 
(2) investments in human capital, and (3) reduced dependence on welfare 
and other public transfers. The hypotheses in Chart 4-1 are based on 
benefits to the program participants. However, many of these benefits 
can be v1 ewed as benefits to the larger society: greater employment and , 
higher earnings imply Increased tax payments from program participants.. 
A reduction in welfare and- other public transfer payments is also 
beneficial to the public. Increased Investment 1n human capital can have 
a direct effect on employer decisions to locate 1n a particular area to 
take advantage of the improved productivity of workers. While even 
general estimates of these larger societal benefits are beyond the scope 
of the present study, the benefit analysis will identify the general . 
implications of the societal- benefits of these programs. . 
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Based on the hypotheses on program benefits, a qUestionnai pewas . 
developed. The questionnaire also Included items on the i parti ciplhtts^- 
evaluation of the program's usefulness. This- questionnai re was reviewed 
by the. Division of Adult Education prior to its use. It is described 
in detail in Chapter III. 

- •• " Chart 4-1 \ ■ f ; 

Summary of Hypotheses Concerning Program Benefits to Participants 



Relative tp what would have happened if they had not gone into the 
program, participants will: 

A; Employment arid Earnings 

1 . Have more empl oyment 
" 2. Pave more stable employment 
3. Have higher earri i ngs/wage rates 

B. Investments in Human Capital 



T. Be more likefy to have productive work experiences 

2. -Be eligible arid more likely to continue on to. higher 

levels of education • 

3. Be more likely to participate ill a dditional train ing 
programs. . . 

4. Have better job-seeking skills 

5. Have clearer job goals 

6. Have an improved self concept 

7. Have more confidence in applying for jobs: 

8; Be more likely to help their children with school 
wo rk 

9.. Be better role models for their children 



C. Reduced Dependence on Welfare and Other Public Transfers 

1. Have reduced receipt of cash transfer payments 

2. Have reduced receipt of in-kind transfer payments 



The questionnai re was administered by mail to a random sample of 
300 6ED graduates and 200 adult high school graduates who received 
their diplomas between January 1 and June 30, 1982.1 Thus, , approximately 
'a year had elapsed; between the time of graduation andthe time of fp'low- 
up. This interval allowed time for program effects to 'materialize while 
minimizing the severe problems encountered by other researchers In 
locating adult students for long-term follow-up (Boggs, et al., 1978). 
Further discussion of the benefit analysis, including the results, can 
be found in the concluding sections of this chapter. - 



I Ths ratio of 300 5EB graduat es to 200 Adult High School graduates is based 
on the rail's- of -program participants in 1981-82. _ . J_ 
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Summary 



This study provided an analysis of the Expenditures arid benefits ; df 
New Jersey 's three diploma-targeted adult education program. fundi rig . 
sources: (1 ) the Adult High' School (formerly 'known as the Accredited; " 
Evening High School}, (2) the AdUlt Literacy Program^ andi:(3) the High 
School Equivalency Program. Data on expenditures were' for the fiscal year 
1981-82. State expendi tur.es for each program were identified in total arid 
on a per-participant basis. AVso, local expenditures for each program 
were identified in total arid on a peh-participant basis. "The benefit 
analysis, which was based on human capital theory, utilized information 
on potential program benefits. The hypotheses concerning these potential 
benefits were generated from a review-of the literature on similar programs 
(for example, Job Corps) and were reviewed by experts and local practitioners 
in the field. A questibnnai re addressing these hypotheses was administered 
by mail to 500 graduates of the programs. J >. . . 



V ■ . Program Costs ' 

I rit rbducti on - ~ -~ s . > 

- The aim of the cost analysis was to examine N§w Jersey's state ; 
ex|3|nditures_for the followi ng three dip] oma-targete,d adult basic ski 1 Is 
education funding sources: (T) the Adult Hi gh_Schoo1{formerl^y 
the Accredited Evening Hi igh i School h (2) the Adult biteracy Program^arid 
(3) the High School Equivalency Programi^ State expenditures for each 
program were identified Tn total and on; a per-parti ciparit^basiSi Based 
on local di strict reports* locaV expendi tares for^each program were also 
identified in total and on a^per-participant basisv Thlv section first 
discussesthe^ participants a program, 
next addresses the participant costi paid for By the Adult biteracy 
and_High School Equivalency funding sources, f inal ly presents the 
findings, conclusions and recommendationi of the cost analysisi 

State of New Jersey also provides funding for adult basic skills 
education. in two other programs, (J) the Supervisors of $dult Education - 
statute, which provides ;furids to eligible lQcat_'sch&ai._.d1i0r1cts for - 
^?7*l*?^?*l a -te : _ p ®i^u C?® 111 ®?*-! up to a maximum of $ J 2,000 j:Vor an adult 
education sup e rvi s o r posit j on; and (2J _-t he _ Evening/ School for th§. Foreign 

Born, , whichTljr^^ match^with^ local mpni\es to a maximum of 

$5y000 for prograins targeted for immigrant adults who wish^to learn the 
English language and prepare for the naturalization process^ \State 

expenditures under the salary reimbursement statute tor^ $638^352 . _ 

in 1981-82, while state expenditures for the Evening ^School for the Foreign 
Born program totaled: $203^000 in that same year. The analysis in this -■ 
report does not. include these two programs based pn the fact that^the^ 
former provides support for a supervisor with responsibilities for 
jjj- adult programs (not just programs aimid at basic skills) w^le the 
latter program is aimed at preparation for the natural ization„.prb.c|SSi 
The target of our* analysis is programs aimed at p rep a rat i opw^p r . awa rd i n g 
of a regular high school diploma ? .or preparation for a High^S^nbbl 
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The Adult High. School 



The Adult High . School is targeted at adults who wish, to_ obtain a 1^, 
regulars local I high schooV diploma. State- support for this prpgra is 
provided through thf^general K-12 education equalization and mini mum. 
aid school finance fomu las. The Education Department 's Division of _' 
Adult Education is responsible for approving thg Tocal districts ' adult ; 
high schools i State aid forthe districts 1 spprpved^programs is calcu- 
lated by the Eduqat^ aid to a : 
local distritt for a particular year I S; based on the, district 's 
September 30th count of full -time equivalent adult high school students--, 
adults are classified as either half-time or full -time students— for the 
previous year. This is the same procedure used for the general K-12 
student population. 

Overview of S tate Aid Fo tmila *, ; 

: : : ; . e 

State aid per adult high school student is calculated on the same 
basis as that- for K-l Z^education; 1 It is given out on a sliding scale so 
that the poorer the /district, in terms of 'property wealth per student,, the 
greater/the state 's share wil 1 be of. the district's budget.: The. sliding / 
scale is based on a gua ranteed tax base (GTB ) formula. Reock (1982) explains 
the f principle, of the New derspy version of the GTB as .follows: 

The equalization support aid. formula "is designed so that, 
within certain limits, aTl districts spending at a given dollar ; 
level for each pupil wil 1 'have the same equalized school tax 
rate. For instance, Under the formula,- a community with only 
$30,000 of taxable property for each pupil could spend $1 ,900 ; 
per pupil and have the same^tax rate as a district with $60,000 
of taxable property behind^each student- which is also spending 
', $1 ,-90ILper_pupi 1 i The State makes-up the difference thlfqugh 
the device of -a "guaranteed valuation." In other words, the 
.State ^guarantees that the district can tax as though it had an 
equalized valuation per pupil as high; as the State's guarantee. 
Without this guaranteed valuation, the poorer district in. the - 
example would need double the tax rate of the wealthier district ' :, 
in order to support the same level . of expenditure. . (p. 3) 

The sffra ranteed valuation is set by the State Legislature at a 
multiple of the state average equal ized^ property valuation per student. 
This multiple 1s set by the legislature*. Chapter 228, Laws of 1982 set 
the guaranteed multiple atH .3235 for 1982-83 (Bureau of Government " 
Research, 1983,;. p.. 40). ' 

\ •■ .■■ • _ j r ■ -A . : j_-0 _ • »>-r V . : _ ■ '. ' ' 

^Fqr a more detailed' discussion of the" New Jersey school finance 

formula see Goertz (1981 ), Reock ( 1 982 ) or Bureau of Government 

Research (1983). \ : . : ' * • 

^Equalized here means, that it is the value of taxable. property, i n a 
district adjusted by. the New JeVsey Division of Taxation to reflect , « 
100 percent of market value. 
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Reock (1982) goes on to note that about y erie-third of the state's 
602 districts have property tax wealth per student (equalized valuation 
per pupil ) that is greater _than the Valuation the state guarantees.; '_ 
Under v a pure GTB scheme, these districts would be entitled to rib equaliza- 
tion aid. However, the legislature has^proyided a minimum amount of aid, 
on a sliding scale of 10 percent to 0, f 7 6r these districts provided that 
the district has less valuation than the mini The 



linimun aid' valuation for 1982-83 is N set at 9.5 times the .state, average y • 
valuation (Bureau of Government Research, 1983, p. 40) TK€ few districts v 
nth valuations per pupil higher than the minimum aid valuation do not 



mil 

val 

wit... . r r 

qualify for general purpose aid from the state. : 



II lustrations of CaldtrTations : * J 

; In order to estimate the effect of adult high school .students on a 
di st rictus state aid, the ,impaet/pf. these students' must be. assessed at 
the margin. This is because -two r factors ^ that detemine state aid to> t he 
distri et are changed simultaneously by the addition of students^" To 
il liistr/ate the marginal state /aid effect, a relatively low -wealth district 
(om^be^w the t guaranteed valuation) and a high wealth district , (eligible 
for mi nTmum aid )_wil 1 be used. 

Cinnaminson. Table' 4-1 shows the marginal state aid .effect for 

1982-8.3 for Cinnami nson School District- in Burlington County, t Cinnami nson 
had 11 adult high school students on the roll on September 30* 1 981 . . . • 
(Recall that state aid is /always based on the prior year's September.30 
enrol Ijneht count i) This is shown oh line A-l . , The equalized property 
valuation for the district was $373,082,250 (Line A -2). With the addition , 
of /the 1 1 adult students, the district wealth per pupil decreased by J _$480' 
per student, from $127,812 to $127,332 (Line A-3). The state guaranteed 
valuation Was equal to $181 ,353 a (Line A-4). ; The aidable J?udget(for di strict 
below the guaranteed valuation is equal to the lower of the district's 
actual* adjusted expenditures 1 in the prior year of the state support limit. 
The state support limit is the maximum amount perstudentfc$hat the state 
will share in support with local districts.* It varies depending on the 
grade plan of the district. 2 Cinnaminson is a K-12 district . The K-T2 



1 The figure is referred to as the district's Net Current Expense Budget 
(NCEB ). This figure .is the district's current expenditures minus- ' 
/ federal aid, miscellaneous revenue, surpluses appropriated, and state 
- / . categorical aVdi 

2 The state support limit is set at the 65th percentile of net current,, \ 
expense budget when all districts within, a given district are, ranked, 
from low to high-. The state support limit is calculated and applied ; 
separately for six district plans {K=6, _k=8, K-12, 7-12, 9-12, County 
Vocational ). (Bureau of Government Research, 1983, p. 86); 
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Table 4-1 



Illustration of Calculation of Marginal State Aid 
Generated by Adult High School Students in ah 
Equalization Aid 'District for 1982-83 



. With Adults Without Adults Difference 

A. Parameters _ _ . ' 

- 1. Students .. 2,930 " -:' _ 2,919 11 

. 2. Total Property Value $373,082,250 $373,082,250 SAME 

3. Property Value/Student 127,332 i • -127,812 -480 

4. Guaranteed Valuation . 181,353 ...... . . 181,353. .' ' . SAME 

5. Aidable Budget 7,566,881 7,566,881 SAME 

B. General Aid Calculation t - 

1*. State Aid Ratio .2979 = .2952 .0027 

2. Total State General: Aid 2^254, 174 2,233,743 $20,431 

C. "~ Capital Outlay and Debt Service 

Aid- _._ . - — -- : _ . •' - ' ■ . ■ -■ . ' . 

1 . Guaranteed Valuation $176,713 . $176,713 SAME 

2. State Aid Ratio .2794 .2767 .0027 

3. Aidable Capital Outlay 38,100,, , 38,100 SAME 

4. Aidable Debt Service 667,196 667,196. SAME 

5. Total State Capital 

Outlay Aid 10,64.5 10,542 - 103 

6. Total State Debt . . = 

Service Aid 186,415 - 184,613 1,802 

7. Total State Capital ! ^~~ ■ : 

•y Outlay and Debt - , > 

Service Aid 197,06^ . — 195,155 . 1,905 

0. Total State Aid B2 + C7 $2,451,234 $2,428,898 $22,336 
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. ' \. : ;• ••/ , : Y. ■ , , " ■; • 42 * "\ •_" : • ■:<■ 

■ \ support 7 l imit i s $2*808 per student J Ci nnami jison spent $7 , 566 , 881 or • 
$2,583 per student in 1981-82. Because the $2,583 is less than 
$2*808* the afdable budget is equal to $7*566*881 (Line A-5). . _ 

The state aidratib is based on the following formula: : 

. . State Support Ratio = 1 - District Equalized Valuation per Piipil ; 

/ ~ ~ Guaranteed Valuation ,A 

Substituting with data from the /Without Adults" column in 
. Table 4-1 we have: .' _j_ ■__ ' ■ ■ 

> v ; ? . . 127,812 - 

. St^te Support Rhtio = 1 - 181,353 . 

: =1 - V7048 

'/ ' " • . ; = .2952 " \ 1 . \ 

' /" ' this state support ratio of .2952 is £heh multiplied by the aidabtie \ 
budget (tine A-5) to yield a general aid amount of $2^233,743 (biiie ?-2}i; 
\ \ If the 11 adult high school students are added to the district student" 
T count , the^progerty value per student \decreases by : $480 (bine A-3)^ the 
state aid ratio increases to .2979 (tiVie B-1|, and State general aid 
increases by $26,431 (tine B-2). Thus^ the marginal state general aid 
generated by_the eleven Adult High school students in £ihnamirisbh totaled 
\ - $20, x 43l. : • • ,\ -\. : ; • . . • ■ • • 

In addition, districts below the g^ also : 

eligible for Jcapital outlay and debt t seryice % aid- The guaranteed valuation 
: for 1.982-83 for the aid is $176^71 3. 1 Using the same basic formula, the_ 
marginal change in state aid for these purposes to Gi nnami nsbh was $lf9G5 
in 1982-83 (Line C-7). 

the total marginal state aid generated by the eleven adult hig^ 
school students in C.ir^ 

aid. to the district was thp_ result ofrthe reduction in prpperty valuation 
per stiident due to^the- addition of the students^ The next example shows 
the marginal impart school students on" a hi gh^ property 

'wealth t (minimum aid)^istrict. . 

^Prior to 1982-83 the guaranteedjvaluation for general aid,' capital : 
. outlay and debt service* aid wasthe same;^ Rowever,^ehapter 228^. taws 
of 1982 "increased the gya ran 

the guaranteed valuation f o r cap i t al ou t 1 ay _ a nd debt service at the 
level set by the 1982-83 Budget. Act. Capital outlay aid is limited to' 
t the smaller^ of ; (V) the_budgeted capital outlay for the pre-budget year* 
\ or (2) 1.5 percent of the sum of the current expense and .budgeted capital: 
\ outlay fcfr the pre-budget year. 
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••: Atlantic City . Jable 4-2 shows the margi hal state aid effect for 
1982-83 for Atlantic City -School District, Atlantic County:. Atlantic. 
City had on its rolls 46.5 adult high school students on September 30, 
1981 (Line A-l). The total property value in Atlantic City was . n 
$2,519,965,594 (Line A-2). . On a^per-student. basis , the property wealth 
was $396,876 with the adult students and $399,804 without them (Line A-3). 
The, guaranteed valuation per student for minimum aid districts in' 1982-83 
was $1*301 ,776, (Line A-4). /In the case of minimum aid .districts? the '* . 
. aidable budget is always equal to the student count times the support 
"limit, even in cases like Atlantic City where the district is not spending 
at the support limit amount (See Table 4-2 footnote);' • 

• ' Table 4-2 ' ■ 

• s . Illustration of Calculation of Marginal State Aid 
Generated by Adult High School Students 
' ' in a Minimum Aid District for 1982-83 . * 



B. 



A. Parameters 

1. Students 6,349.5 

2. Total Property Value 2,519,965,594 

3. Property Value/Student 396,876 

4. Guaranteed Valuation 1 ,301 ,776 

5. Aidable Budget 1 17,829,396 



Without Adults Difference 



General Aid Calculation 

1. State Aid Ratio '■ ; . .0695 

2. - Total State General Aid $1,239,143 



6,303 
2,519,965,594 
39 9 7804" 
1,301,776 
17,698,824 

.0693 
$1,226,529 



46.5 
SAME 
-2, 928 
SAME 
+1 30,572 



.0002 
$12,614 



Capita^ Outlay and Debt Service Aid 

Minimum raid districts do not qualify for state aid in—these 
categories. '"*••." 



D. Total State Aid 



$1,239,143 



$1,226,529 $12,614 



iThis district's actual net. current expense budget was $14,159,919,° but 
like all _mihi mum aid districts state aid .is based at the maximum; support 
level. The' maximum support' level in calculations for 1982-$3 aidjror 
K-l 2 districts was equal to l$2ijB08 jtjms_the_enrolled2studeht'S;: -this 
fact accounts for the* difference in the: aidable budget ($130,572 is 
equal to 46.5 times $2,808). r l 
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Thus, the aidable budget with the 46.5 adult high school students is . 
$130/572 "higher than it.would be without them ($2,808 times 46.5 equals . 
$130,572); 

The formula for calculating the state aid ratio for minimum aid • 
districts is: , 

State Aid Ratio =1 - District Equalized Valuation per Pupil x 10% 
. • Minimum Guaranteed Valuation 

Substituting with data from the "Without Adults" Column in Table 4-2 
we have: ' , 

State Aid Ratio = 1 - 399,804 x 10% .: *" 

1 ,301 ,776 . 

= 1 - .3071 x 10% 

i. : " :. •«.. : ; .6929 X 10%- ' ; , ! 

.0693 

. i jhis state aid ratio of .0693 is then multiplied by the aidable budget 
of $17,698,824 to yield a State general aid total of $1 ,226,529. When the 
46.5 adult students are added, two changes occur automatically in mimmum 
aid districts; (!) district wealth per student decreases and (2) the aidable - 
budget increases. 1 The reduction in wealth per student, for example, fronr 
$399,804 to $396,876 in Atlantic City, thus increases the state support ratio. 
In the Atlantic. City example, the ratio increases by .0002 to .0695 (Line B-l). 

This increased state aid ratio if then' mult^ 

budget to yield a state general! aid total of-;. $1 ,239,143 which is-$l2,6l4 
more than state aid would have. been without the 46.5 adult high school 
students (Line D). Because minimum aid districts do -not qualify for capital ^ 
outlay Or debt service aid (there is no minimum aid provision for these - 
categories) the $12,614 is the total marginal state aid to the district 
generated by the 46.5 adult high school .students. This marginal aid^ was the 
result of the reduction in property valuation per student and the increase: 
in the aidable; budget. r - ' .-- , !.,■ 

Marginal Versus Average Cost • — .. 

In the precedi ng analysis,- an estimate. of the state aid change due ...» 
to the addition of adult high' school students was analyzed at the margin. 
That is, the change in State aid was estimated from the: viewpoint that 
the adult high school students were the last students added to the-total . 
The analysis of the estimated state. aid change-has to be made in this 
manner because the addition of students at the margin.. lowers the property 
valuation per student and thus affects the amount of state aid generated 
for all students, not just the adult high school students. Using the . - 
general aid calculation data in Table 4-1 ,• the average state aid Without 

If he aidable budget would al so automatical ly i nerease i n a low wealth 
district if thi district were, spending at or above the state support Limit. 
Jn minimum-aid districts, -however, the lidable budget is always increased 
"because state aid to thesep^tncts is cal eulated at the state suppprt 
1 1 vel independent of the actual level of district expenditure;. :. 
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Adults" is equ^l to lirie B-2 divided by lirie_A^vthat is $2*233*743 - 
divid^ " ~ _ 
represents the average .state aid received in the "Without Adults" situa- 
tion. When the eleven fadult high school, students are added, the average 
state aid increases by $4,10 to $769.34 fop al 1 students; The marginal 
-eh^nge~i-s-equal to $26^431 which consists of $11 ,967i90--based on the 
$4.10 increase for the 2,919 non-adult students— plus $8,462. 74--the . 
increase for the eleven new (adult) students who receive an average of 
$769.34* The enti re chan^eof $2B,43l , however, is the direct result of 
addihg on the eleven adult students. Thus, the margi nal -[nere'ase in 
state aid generated by the adults is i the combined effect of the change in 
the base enrollment and' of the additional students^ 



, 0nde ; the state aid is received in the "district , to^t fi a . district is— 
viewpoint the average aid is the same for ^11 students, $769^34 i n the 
above example. Howeverj the above example^demonst rates that adding 
students to the base (that is, adding "at the margin") 
result in an increase in the average aid^per student but instead results 
in a two-fold increase by (1 ) qua] i fyi ngthe district for higher aid per 
student for all of the original -students and by _-(2-J applying this new 
average to the additional students. Thus, to estimate state expenditures 
for the Adult High School program; the estimate musts.be made on a marginal 
bajri s recognizing that thellocal district may view the situation from an 
average basis. 

_ _ -■■ _ , 

Participants jnd Expenditures 

Data on enrollment in the Adult High School program. (Accredited 

Evening High School ) are available from working documents compi Ted by the 
Division of Finance within the' Education Department . ^ ^Data^ n: the , 
estimated marginal amount of state aid associated with Adult High School 
enrollment is not routi nely compi led. However, in January, 1982, the 
Division of Finance did compile and analyze the marginal aid generated 
by Adult Hi gh School students "for 1 981 -82 and also made an estimate of 
the anticipated marginal aid for 1982-83 (Division of Finance memo, 
January 19, 1982),. The Division of Finance made available this special 
analysis for use in this study. s Local expenditurereports on Accredited 
Evening Schools are annual ly col lected by tbe Di vision of Fi nance and 
reported in the Commissi oner's annual financial statistical report 
(Commi ssioner of £ducatibn, . prepubli cation copy of the T fti rt ieth Annual 
Report. ) The latest available report is for school year 1980-81; An 
estimate of the local expenditures for the 1981-82 school year will be 

made based on the per student estimated change in the regular!. K-l 2 

education program. ; The K-l£ estimated expenditure increase per student ^ 
between 1980-81 and 1981-82 was 13.4 percent.' 1 ' To'" estimate the 1981-82 
total local expenditures for adult high schools, the* per-student 
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if hi s estimate was developed from a recently publi shed report by the 
Bureau of Government Research at Rutgers University (1983). On page 
25>df that report 1 , ah estimate -of New Jersey public sfchool expenditures 
in current dollars for 1980-81 and 1981-82 is ^hown. On page 33 of 
the report an estimate of the number of pupils in average daily enrol Intent, 
for the same years is~given. Combining this information results in an 
estimated average expenditure of $3,281 JV in 1980-81 and an average of ; 
$3*721.94 in 1981-82. The shange between iy ears is equal to 13.4 percent. 
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expenditure total for 1980-81 will be increased by 13.4 percent and 

multipired by the September 30 ^ 1981 statewide adult student count. 

■ ■ ■■ ^ 

Table 4-3 presents data on the participants, total state 
expenditures, per student state expenditure, total -local expenditures 
arid local expenditures per student for New Jersey's Adult High School 
programs. On September 30* 1981_there were 12*311 full-time equivalent ; 
students enrol led in Adult High School programs ^(Di vi si on of F i nance 
memo,* February 11, 1982). The Education Department's Division of 
Finance, using the marginal analysis method described above, estimated 
state aid generated by the prior year's adult students for 1981-82_state 
aid to total, $11 ,550,503 (Division of Finance merrx), January 19, 1 982 ) ^ 
This state aid is. equal to $938,03 per student enrolled on September 30, 
1981 (Table 4-3, line B" divided by Line A), The estimated . local expendi- 
ture per adult high school student in 1981-82 is $193.43. This estimate 
is based on local district reports to the state that show total local . 
expenditures for Accredited Evening Schools for 1980-81 of $1 ,889,713 
(Commissioner of Education, ^republication copy of Thi rtieth Atfriual 
JRe£ort). there were!! ,079 students erirbllediri adult . schools on 
September 30, 1980 (Divisiori^bf Finaric^^ New Jersey Education Department* 
worksheets^qn adult high school enrollment/) Thus, the average reported ....... 

local expenditure in 1980-81 was $170.57 ($1,889,713 divided by 11,079). 
In order to arrive at- the estimated per-studeht 1 deal expenditure for 
1981-82 of $193.43 (Line D in Table 4-3), the 1980-81 average expenditure 
is increased by 13.4 percent, the anticipated increase-in expenditure for 
T;he overal l K-12 program>etween 1980-81 and 1981-82 noted a£ove. This 
estimated 19-81-82 local expenditure w^as^maltiplied by the September 30^ 
1981 student count (bine A in Table 4-3) to arrive at the estimated 
total local expenditure for Adult High Schools of $2,381,317 ^ 

Findings and Conclusion s^ . ' / 

\ . The data in i Table 4-3 indicate that adult high schab^ studehti_. 
"generated considerably more stat aidper student than the estimated 
Expenditures made by districts on these programs in r 1981-82. The/ 
average aid generated per .adult enrol led on September 30, 1981 was 
$938.0.3 compared to an estimated local jexpenditure (based qn local '_ 
reports) of .$193.43 per student. While there fs a wide estimated variance 
in state aid to. Iqca] expendi ture, it should be noted that a certain 
degree of averaging in state aid formulas is necessary. "For example, ■. 
a gym class of 40 students taught by a new' teacher wil 1 1 have a/ Tow per- 
stu dent expenditure need compared to an advanced math class of 10 .students 
taught by a teacher with 20 years of teaching expeience,. Analysis :of__ : 
state aid. to students"^rn : these two classes would show the same state aid 
per student. Yet, because of the higher class size and lower teacher 
salary , students in thergym cTass wpuld show a relatively low per-pu pi 1 
expenditure and students in the math class "would show a relatively high 
per^pupil expenditure. The average state aid is distribute^ unequal ly to 
pay for the additional cost for^the math class. In essence, the low- 
experiditure gym class subsidizes the high expenditure math/ cTass. The 
data in Table 4-3 indicate that a similar situation exists^ with the Adul^ 
High School program. Because the state of NwJersey does not mandate_ 
that revenue, generated .by adult high schqol 'students be spent solely on ". 
these students, local distri cts are us ing the "surplus " Revenue frqm the 
Adult Hi gh School program to help finahce other existing /program needs. 
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TaPl e 4-3 



Participant arid Expenditure Data fat Adt*11: High Schools 
in New Jersey for 1981--82 1 



A. Full Time Equi valent-SttTdents 12,311 

(September 30, "1981 count) 

B. State Aid Generated by "Adult 

High School Students 111*550,503 

C. State Aid per Adult High 

School Student . : $938.03 

Di Estimated Local Expenditure per - 

Adult High School Student $193,43 

Ei Estimated Total bocal Expenditures 

for Adult High School Students 3 2,381, 3i 7 



^Sources of data: tine A data is prevised count Compiled by the 
Bivision of Finance on February U, 3982. J.ine B was compiled by 
the Division of Finance and reported in a memo dated daruary 19, 
1982. Line C is equal to Line B d1 vided by Line A-,. Line D is. based 

on the reported expenditures for Accredited Eyeni hQ Schools in the 

Thirtieth Annual Report of the eojTwHss ioner of Education- (Ebmmissioner 
I of Education, prepubli cation copy ) This amount is $1,889^713 forV 
1980-81. The September 30, 1980 c^unt of Adult High School students 
based on statistics compiled by the Division of Finance tfas 11,079* 
Thus, the average local cost was $170.57 ($1,889, U3 divided by 11,079)* 
This figure was increased by 13"i4 percent Itfee estimated Increase in the 
K-l 2 program. mentioned above "in the text) fccrarri S& at the local estimated 
expenditure of ,$.193.43 for 1981-82. The $193.43 *<as multiplied by the 
September 30, 1981 student count of 12,311 (Line A) to arrive at the 
estimated local cost for 1981-82 of 52,381,317 shOt*n on tine E. 
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The^siturtlon could, however, result in districts using the Adult High ■• 
School to . generate. "surplus" revenue- beyond what state policymakers . 
would view as a reasonable exercise of the averaging need. The "surplus" 
revenue situation may help explain the 18.3 percent growth in adult high 
school enrollment between September 30, 1980 and September 30, 1982 while 

regular school enrol lment (and associated -state aid) declined' by 5 t .9 

percent.* 

Recommendations 

Because verification of expenditures reported by local districts 
for the Adult High School is beyond the scope % of this study-, it is 
recommended that the Department of Education verify these reported*' - 
expenditures. If the Department of Education confirms substantial. _ 
"surplus" revenue beyond what state, policymakers view as a reasonable 
exercise of the averaging need ^ it is further recommended that the 
Department of Education (1) establish a "standard of service" for the 
Adult High School program^ (2) develop a separate funding" formula for. 
the Adult High School program based on the establi shed" "standard pf 
service," and (3) require separate local district accounting foe the 
( Adul^ High School program with provisions^ to ensure that state' aid 
receiyed x in the local district forvthe program be spent only for that 
"program, with surplus revenue to be returned to the states 

Adult literacy and High School : Equivalency Funding Source s 

The Adult Literacy and High School Eguiyalency programs are targeted 
for adults who»wish to prepare for the Test of General Educational— 
Devel opment (GEO ) . Di stribution of ^state support to 1 ocal di stricts 

for this type of program is based on' evaluation of annual- district 

applications to the Education Department *s i Division of Adult Education.. 
In-order to maximize the use_ of avai lable siate_f unds, the Di visions 
eval uation takes i nto account t'he avail abi If ty to 1 ocal districts of 

federal basic skil Is funds. The Division utilizes the State Adult 

Literacy and High School Equivalency funds for local basic skills program- 
ming in English or, to the extent necessary, in the native language of 
the adult learner. Thus, the Di**£jon categorizes its basic skills 
programs as (1) English Basic Skills, (2) Bilingual Basic Skills, and 
(3) English as a Second Language. Also, for purposes of program 
managementr ^S-ic^kifls programs for adults 'are organized intb four 
levels according to' readi rig proficiency. These levels are- as follows: • 

Li - ... ! * 



Ijhe Division of Finance reported Adult High School enrollment of 
13,111.5 on September 30, 1982 compared to 11,079 on September 30, 
1980, See Bureau of Government .Research, 1983, p. 33 for average 
decline of K-12 average daily enrollment. 
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bevel 



i: - 0 to 3rd grade reading level 



.bevel II : 4 to 6th grade reading level 
bevel Hi: 7 to 8th grade reading level 
IV: 9 to 12th grade reading level 



Al gorithm .Needed to Estimate Expenditures par Participant 



expenditur 
support aS*e reported 
the Division ^of- Adult 
federal basic skills 
serves alL_SE5_stu_ 
designation (federal 
state support across 
Skills, Bilingual Bas 
(2) separate state-su 
each program option. 

Expenditures 



es for Adult Uteracy and; High School Equivalency 
in the annual Governor's Budget.. However, because 
Education combines state "funding with available 
fund.ing and b^c^se_ : the_program at the loclal level 

_i n- one~~S v ett1ng Independent of the funding source 
or state), an algorithm 1s needed to (1) estimate 
the three available program options (English Basic 
1c Skil Is and English as a Second banguage), and 
pported from federally-supported students Within 



i 



Table 4-4 summarizes the known amounts of federal and state support 
for the three program options, bine 1 in Table 4-4 shows the Governor's 
Budget total of expenditures for the Adult bi tera^^ndlULgtL-School— - - - 
Equivalency programs for 1981-82^ — U-n^2-^"oWs"Total federal and state 
expenditures fox each of the- three program options. The Division of 
1 AduJt Education estimated that $137,930 of the State Adult, biterjacy 
expenditure was used for the English - as a Second banguage program with 
no funds from the High School Equivalency source for that program 
option. This figure is shown on bine 3. The Division further provided 
a breakdown of federal and state expenditures for the B1 li ngual 'Basic 
Ski lis program for 1981-82. This estimate was developed from a j review 
of each individual district's budget. The federal and state totals are 
shown on bines 4-A arid 4-B iri Table 4-4. 

Table 4-5 presents the algorithm used to estimate federal arid state 
expenditures for the English Basic Ski lis program option using the 
known data shown, in Table 4-4. _ bine 1-C shows the total 1981-82 federal 
and state expenditures for English Basic Skills arid Bilingual Basic 
Skil ls_prbgrams. This is the same as that shown 1ri Table 4-4^ lories 2-A 
and 2-B. Shown on bine 2-C is the total state, expenditure for English 
Basic Skil Is arid Bilingual Basic Skil Is, given the fact that in {Table 
4-4, bine 3 only $137,930 of the, total of these programs was used for 
the English as a Second banguage Program option. Table 4-5, binje 3 
Shows an estimate" of total federal funds for, the Engli sh Basic Ski lis 
and Bilingual Baste Skil Is programs. That estimate is equal to Line 1-C 
less bine 2-C_ in Table. 4-5 i Given the estimate of federal funds! spent 
on Bi'liricfual Basic Skil Is from Table 4-4, bine 4-A," an estimate of 
federal funds for English Basic Ski lis program support"! s f made on bine 4-C 
in Table^-S. An estimate of state expenditures for English -Bash'c Skills 
program support then is made bri bfrie 5-E in Table 4-5. Using the 
algorithm we have, thus made it possible ttf estimate federal arid state 
expenditures for each of the three program options^ 
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Table 4-4 

Known Amounts of Federal and State Expenditures 
for the English Basic Skills Program, Bi 1 inguar Basic Skills Program 
and English as a Second Language Program for 1981-82 

State Expenditures 1981-82 (Governor's Budget) 1 

A. Adult Literacy . $ 979,154 

B. High School Equivalency 1,214,606 

Total $2,193,760 
Total 1981-82 Federal and State Expenditures for the Program Option 



2 



A. English Basic Skills $3,258,215.68 

B:. Bilingual Basic Skills 408,461.80 

C. English as a Second Language 1 ,18 0, 594 . 0 2 

Total ' $4,847,271.50 

State Total of Adult Literacy 

Funding Used for English as a . 

Second Language in 1981-822 $ 137,930,00 

Breakdown of Federal and State . ~, 
Expenditures for the Bilingual Basic 
Skills Programs for 1981-82* 

A. Federal subtotal $ 89,765.00 

B. State subtotal 318,696.8a 

Total 1 408,461.80 



iData from Governor's Budget for Fiscal year 1983-&4 (State of New Jersey, 
January 31, 1983, p. 334). Adult Literacy total includes $171,113 
transferred to Department of Higher Education.. High School Equivalency 
total includes $138,056 transferred to Department of Higher Education. 

2 Data made available by Richard Hitt, Division of Adult Education. - 
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Table 4-5 

v , ■ . 

\ * " 

Algorithm to Estimate the Unknown Amountst^'f Federal and State. Expenditures 
fbrVthe EriglishBasic Skills Program, Bilingual Basie_ Skills Program 
arid English as a Second Language Program for 1981-82 

1. A. Engrish Basic Skills Program ^ $3,258,215.68 
B. BilinWV Basic Skills Program _48B,451^Ba 
G. Total English arid Bilingual Basic * _ 

Skills Programs $3,666,677.48 

2. State .Total for Engli sh Basic Skil ls arid ■ 
. Bili ngual Basic Skills Programs 

A. Adult Literacy ($979,154 less $137,930) $ 841, 224; 00 
Bi High School Equivalency _i 1,214,696.88 
6; Total State Expenditures for English * 

Basic Skills and Bilingual Basic Skills 

Programs $2,055,830;00 

3; Estimated Federal Funds for English Basic 
Skills and Bilingual Basic Skills Programs 

(Line 1-C less Line 2-C above) ' $1,610,847.48 

4; Estimated Federal Funds for English Basic 
Skil Is Program 

A; Line 3 above j $1,610,847.48. 

B. 'Less Line 4-A, Table 4-4 , 89,765.00 . 

C. 'Eguals Federal Funds for English 

Basic Skills Program $1,521,082.48 - 



5; Estimated State Expenditures for English 
Basic Skil Is Program 

A; Federal and State Basic Ski 1 1 

Amount (Line 1-A above) • $3,258,215.68 
B. Less Estimated Federal (Line 4-C above) 1,521,079.48 
C; Equals Estimated State Expenditure for 

English Basic Skills $1,737,133.20 
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Participants. - :: 

As mentioned aboye; the Di vi sion of Adult Education organizes its : 
programs i nto four 1 eve Is accordi ng to readi ncj prof ici.ency- At the local 
level, participarits_are not placed according to funding source but rather 
in accordance with thei r._ educational need (as defined by the readi ng 

proficiency level j. Participant data, therefore, is available only by 

reading proficiency level. The task is to decide how to estimate the number 
> of participants .being supported with state "funds as compared to the number 
being supported with federal funds. 

After discussion witfi "the Division of Adult Education, it was decided 
to count all participants at* levels I and II as federally-supported 
students and al 1 participants at levels III and IV as state-supported 
students. The basis for this jis the decision to consider federal dollars 
as the ones being used for students with the greatest educational need 
while the state dollars are being used to support students who are closer 
to the point of taking: their GED exam. ^However, sufficient data will be 
reported in order" to allow sensitivity analyses of alternative assumptions 
on. the appropriate distribution of program participants. ~ / V 

Because the Division does not apply the four levels of proficiency 
to the En glish as a Second Language program option, it was decided; to 
. , allocate participants in that program on the basis of relative percentage 
of federal versus state^suppfirt. Total .federal and state support for that 
option was $1,.180,594..02 of which only $137,930. or 11.7 percent was state 
of New Jersey funds. Therefore, 11.7 percent of the participants in the 
English as a Second Language program^vere cohsi de red state-supported. 

Participants arid Expenditures - 

Table 4-6. presents data on (1) the 1981-82 federal , state arid local . ~ 
expenditures in total and for each of the three program options, (2). the 
estimated number of participants in each option by funding source, and 
(3) the cost per participant; by program option and in total.* Fpr both 
s the English Basic Skills arid Bil irigual Basic Skills programs, the federal/ 
state al location of participants is. based on a decision to consider: all ■ 
level I arid 1 1 students as being federally supported arid all level III arid 
IV students as state-supported. Thus, the 9,145 level I and II students 
in the English Basic Skill option in 1981-82- are considered to be receiving 
federal sup port 7 In reviewing the data in Table 4-6, note tfiat the 
figures in the "Total" column do not always represent the sum of the three 
preceding columns. _ For instance, the Total Participants is always- the 
same as the Local Participants which is the sum of the Federal arid State 
columns i Also, the total Expenditures/Participants is the overall average 
rather than the sum of averages of the . precedi ng columns. 

Overal l , -the.^$2, 193,760 in state expenditures spent on al 1 three 
options helps to provide program support for ari estimated 18,175 partici- 
pants. This is an average state expenditure of $120.70 per participant 
(see second column on Line 4 in Table 4-6). Local districts reported 
spending an additional $32^34 per program participants Thus* the state/ : 
lo.cal cost is an estimated $153^.04 ,per- participant. This figure is almost 
identical to that found for the federal /I deal Expenditure for the estimated 
22,065 participants identified as having primarily federal support. That_ 
combined figure is $1.52.59^ 
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Federal, State and tocal Expenditures for 
GED Target ed Adul t pas i c Sk i 1 is Educat i on 
Programs in New Jersey. 1981-82 1 



Program Option 



Expenditures and Particip a nt s ' 



Federal 



Stat© 



Local 



Tot a l 



1. English Basic Skills _ 

-. Expenditures $1,521,082.48 $1,737,133.20 $ 966,491.87 $4,224,707.55 

Participants . 9,145 15 , 251 24,396 ■ _ 

Expenditures/ 

Participants $ 166.33 $ 113.90 $ 39.62 



173.17 



2. Bilingual Basic Skills 



Expendi tures 
Participants 
Expenditures/ 
. Participants 

3. English as a Second 
Language 
Expenditures 
Parti ci pants 
--Expenditures/ 



$ 



89,765 . 
928 



$ 318,696.80 

-1,335 



$ 128,339.20 $ 536,801. {. 

2,263 



96.73 $ 



238.72 $ 



56.71 $ 



237.21 



$1,042,664.02 $ 137,930 
11,992 1,589 



$ 206,609.08 $1,387,203.10 
13,581 13,581 _ 



Participants 

4. Totals 

Expendi tures 
Participants 
Expendi tures/ 
Participants 



$ 



86.95 $ 



86.80 $ 



15.21 $ 



102.14 



$2,653,511.50 

22,065- 



$2,193,760 
, 18,175 



$1,301,440.15 '$6,148,711.65 
40,240 ■ , 40,240 



$ 



120.25 $ 



120.70 $ 



152.80 



s 



iData Sources: For federal arid state expenditure data see Tables 4-f4 and 4-5. 
Local expenditure arid participant data from Richard Hitt, Division if Adult 
Education based on March 31, 1983 computer printout. See text for Allocation 
of participants within programs. 




Findings and Conclusions \ S - ' 

The review of the .data in Table 4-<f yields no unusual findings. The 
. most stMJdrig statistic is the^overal V cl osehess of the state_and federal 
expenditure per participant. That finding could be attributable to the 
application approval process of the Division of Adult Education in which: 
they take into account the availability of federal- funds in the allocation 
of state dollars. Howeverythat conclusion is really beyond the limitations 
of the data presented in Jable 4-6. t 

Recommendations x 

It is recommended that the data in i Table 4-5 be reviewed and verified 
by the .Department of Education. It is further recommended that the 
Diyisibn of Adult Education keep a separate record of federal, and' state 
allocations to local school districts. Currently ,_the Division^ computer 
records show a combined federal /state totals For purposes of ease of 
analysis^ it, would be^desirable to show a separate record of the state and 
federal funds. The fiscal data i_n Table 4-6 are expenditure data. Like 
the the Adult Righ School program, the GES-targeted programs do not have, an 
established "standard of service;" While the issue of state support to 
local expenditure has not risen in the GEp-targeted program area; as it did' 
in the Adult High School ^program, it is nonetheless desirable to .establish 
a "standard of service" for_the ^GED-tarpted prosrams.. . Without such a 
standard, the "cost" of these p^grams is not determinable. It is, therefore 
further recommended that the New dersey State Department of Education 
establish a "standard' of service" for the GED-targeted programs.! This 
task could very easily ^ be completed atthe same time that the standard for" 
the Adult High .Jj^ High 
School); Oncea' standard is determijied, the»desired level of state/local 
share of the cost of the progranVcan be established. 

. Summary . . . • J . . 

The aip of the cost analysis was to examine New Jersey's state . ; 
expenditures for 1981-82 for the following three diploma-targeted adult 
basip skills education funding sources: (1) the Adult High School/ 
(formerly known as the Accredited Evening High School ), (2) the Adult 
Literacy program, and (3) the High School Equi valley : program. Sjtite 

- expenditures^for each program were" identified in total and on a tfer- 
participant basis, tocal -expenditures for each prpgram were also identified 

: in total and on a per-participant basis; _ ■• / 

Adult High School / . 

It was found that adult high school students generate considerably 
more state aid per student than the estimated' expenditures made by the 
districts on these programs in 1981-82. The total state aid/generated for" 
programs for the 12,311 adults enrolled on September 30, 19^L totaled. 
$11.55 mil li on. The. estimated local expenditures; on programs for Adult 1 , 
High Schools that; year was $2.38 million; On a per -participant basis* 
state aid totaled $938.03 while"esti mated local expenditures (based on , 
local reports) totaled only $193.43 per student. * Because the state of New 
Jersey does not mandate that revenue generated by the Adul/t Hig*rSchool 
students bi soent soley on these students, .local district^ are Rising the 
-< "surplus" njl^iue from the Adult; High-School program to 
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existing program needs. Thi^ "surplus" revenue sUuatiori may help explain 
the 18. 3, percent growth in Adult High School enrol lment between September 30 
1980 and September 30, 1982 while regular school enrollment (and associated., 
state aid) declined by 5.9 percent.. 

Based on the cost analysis of the Adult High School program the 
following recommendations are made! ' * 0 "> 

(1) The Department of Education verify the reported local 
expenditures for ^the Adult High School program. 

(2) the Department of Education establish a "standard of 
service 11 for the Adult High School , program. 

(3) The Department of Education develop a separate funding 
formula for the Adult High School program based on the 
established "standard of service*" arid ; ; ; 

• (4 ; ) the Department of Education require separate local. 

district accounting for the Adult High School program 
with provisions to ensure that state aid received in 
the local di strict for the program be spent only for, 
that program and any surplus revenue .should be returned 
— • to the state- , . y '■ ; 

Benefits Analysis 

A ful? description of .the methodology employed to secure data on the * 
benefits of obtaining a high school credential is provided in Chapter 3. 
Here the concern is with reporting the findings so that, judgments can be 
made concerning outcomes and impact in relation to costs. 

Benefits, must be viewed from two rather different perspecti ves. The 
first, what might, be called the micro perspective, emphasizes, the benefits 
gained ^^sub-grotips of . the population and, thus sheds light on program 
effectiveness in meeting i ridi vidual or sub-group needs. The second, or 
macro perspecti ve, addresses outcomes without reference to the specific 
needs or goal s of indi vidual s. or sub-groups and thus provides a picture of 
overall ...outcomes or program impact. To il lustrate this distinction, 
c oris i der -the benef i t of obt a i hi rig emp 1 oyment . F rom the mic ro _ pe rs pect i ve, 
this outcome js meaningfulonly to that subrgroup. of the population v 
consisting of persons who were unemployed and seeking employment prior to . 
graduation. This sub-group experienced significant gains in employment, 
suggesting that. the program was~ef feet ive in meeting thei r need.. HoWever, 
from the macro perspective, gains in employment Were relati vely . modest . 
The reason is that the majority of the population were employed both prior 
to and after graduation, - Thus, overal 1 , there was limited potential for 
employment gaihsV Both perspecti Ves j of'course, are valid; they simply 
emphasize different kinds of information; 

The fi ridings are organized and reported in two general sections, the 
f i rst dealing, with nvicro benefits and the second with macro benefits or 
overall impact i 
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Micr o Benefits 

*'* " Because the BED a^d AHS samples were drawn from -di if fererit populations * 

from a strictly technical point of view f tiTdi ngs for each group should be 
reported separately. To do so, however, would be exceedi rigly cumbersome 
and detract from our purpose of providing an 6 vera! 1 picture of benefits 
gained, regardless of type of credential. Consequently, the micro analysis 
is based on the; combined data from trie two samples. The reader is 
cautioned_that the findings are only suggestive of inferences that might 
be made to the total population of interest. I 

These _ findTngs, r and all others, are organized uridSr the previously 
discussed general categories of (1) Employment and Earnings, (2) Reduced 
Dependence on Welfare and Other public Transfers, and {3) Investments in 
Human Capita V. Following the data for the combined sample, outcomes for 
the adult high school and GED graduates are compared; Only statistically 
significant differences are reported. The section concludes with an 
analysis of graduates' perceptions of the value of the adult high sthools 
and GED programs in helping them attain a-high school credential . ? 

f Macro Benefits 

To reiterate, the macro perspective provides information on benefits' 
for the overall population without regard to sub-group differences in 
needs or, goals. This r is the Mild of information typically reported in 
outcome stucfres.^ Success is judged-on-the-basis of achievement of officially 
. stated objectives, which are presumed to be relevant to the enti re^population. 
Outcomes or benefits are typically equated with overall program impact. 

I.H determining what findings to report in respect to macro benefits, 
the decision was made to adhere to conventional scientific criteria, that, 
is. not to aggregate the data from the GED' and AHS samples^ Thus, findings 
: ere reported only for the GEO sub-group. We view this as the preferred 
Alternative for the following reasons:. (1) the AHS sample is small and 
not strictly random; inferences can only be made to the limited population 
from which the sample was drawn; (2) the majority of adults in New Jersey 
earn GED rather than adult high school diplomas; (3); the GED sample was 
drawn randomly from a large and representative population; moreover, its 
standard error is known (+_ 3%), thus allowing for some precision in : 
estimating population values; (4) finally, the actual number of GED ..." 
graduate? for fiscal year 1981-82 is known, thus permitting estimates of 
outcomes in terms of actual number of graduates. : - . „ 

In order to make the estimates in Section, 2, certain assumptions and 
adjustments had to be made. First it was assumed that adults who passed the :v 
GED test between January 1 and Apri 1 31, 1982 (the sampling frame) were 
representative of those who passed during the other. months ^6f fiscal year 
1981-82. In regard ,td. adjustments, only that, proportion of the total 
(48%) estimated as having prepared for the GED by participating in adult 
basic skills programs was included in computing estim§tesi Secondly , those 
who passed the Spanish form of the test (17%) were excluded from the - 
calculations. Thus, the total population of GED gradates (7,671) was 
adjusted downward to 3,056. *- ' . • 
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Section--' 1 : Micro Findin gs- 

The findings; presented below are based on the combined GEp and AHS 
sample data. For the sake of parsimony, they are presented as simple 
percentages. For items applicable to al 1 respondents, such as most of 
those in the Human Capital category, percentages were calculated from a 
base of- 250. For all other items* the base N varied depending on the size 
of the relevant sub-group (e.g. , those with children, those employed ^ etc. ) 

Employment and Earnings. Twelve to - 
Eighteen Months After Graduation 

1; Of graduates initial ly unemployed and seeki ng empl oyment-,— 58. 3% 
obtained jobs. This gain is somewhat offset by 14.8% who were 
initial ly empl oyed but became unemployed. # 

2. Of graduates Initially employed part -time* 44.1% obtained full -time 
employment. This gain is slightly offset by 7.1% who were 
initially employed fu^l -time but subsequently became employed part- - 
time. 

3. Of graduates initial ly employed and still employed at the time of 
the follow-up, 44.6% reported that they obtained better jobs . 

4. Of graduates initial ly empl oyed and s ci.l 1 employed at the time of 
the follow-up, 93.1% reported an increase in earnings. 

5. Of graduates initial ly employed and still employed at the time of 

the follow-up, 29.0% reported that they had received a job ■ • ' . 

promotion. 

6. Of graduates initially empl oyed__and„st ill employed at the time of 
the follow-up, 77.8% reported that they were more likely than before 
to keep thei r_jobs . 

7.1 Of graduates initially emp^dyed and still employed at the time of 
follow-up, 76.2% reportetfthat they a're now able to do thei r jobs 
better. . # v ■ ^ 

Of the seven benefits above rel ated to employment and earnings, 
100% *of the graduates reported at least one benefit, 50.4% reported three 
or more benefits, and 13.3% reported five or more benefits. It should be 
noted in addition that the average number , of months employed in the 12-month 
period prior to graduation was 7.7, compared to 9.0 after graduation . 
Specific findings related to increased earnings are listed below 3. / 

1. For graduates employed full-time, both initially and at. the time of 
the follow-up (N =35), the mean weekly increase in take-home pay was 
$63.72. • 

2i For graduates employed; partrtime, both initial ly and at the time of \ 
the follow-up (N = 103 ) , the mean weekly increase in taker-home pay \ 
was $33.50. * '< 



3i Fqr graduates initial ly employed part-time who had gained ^full-time 



58 



employment by the time of the follow-up (N = 74), the mean weekly 
increase in take-home pay was $87.73. ^ 

4. For the total sample (N = 250), the mean weekly increase in take- 
home pay was $26.18.,. This can be extrapolated to a cumulative 
annual gain in take-home pay of $341,675 for the total sample- 

Reduced Dependence on Wei a re & Public Transfers 

Twelve to'Efghteen Months After Graduation : 

1. Of the graduates who had initially received welfare payments and 
public transfers {e.g. , food stamps), 5i% recei yed^no public _ c 
assistance at the time of the follow-up; This gain i sjsl i ghtly 
offset by 4.7% who hadnrot- received public Assistance -prior to 
graduation but did at the tine of the follow-up* \ 

Investments in Human Capital Twelve 

to Eighteen Months After Graduation : y . * * 

* 'i ? 

Since earning their high school credential: . \ ; * 



1.. 29.3% of graduates enrolled in college*. \ 



2. 30.9% enrol led- in a job training program cfr a trade or technical 
school . \ -f - 

3. 86.5% reported improvement in their reading, writing, or math skil Is. 

4. 95.6% of those with children reported that they now. set a better 
example for their children. ' A \ \- \ 
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5. 66. 5|^ reported that they now know more about how. the government works. 

.6. 92.8% reported that they now fe^l better about; themSelVess, 

. Of the six benefits above related to investments inhuman capital, _ 
100% of the graduates reported at least one benefit* 85.3% reported three; 
or more benefits^ and 22.9% reported five or more benefits. ^'. 

Comparison of Benefits for GED 
& Adtilt High School Graduates 

The AHS graduates Were less soci oeconomical ly advantaged th;an*thjei r 5 . 
GED counterparts. . To illustrate, 55% of AHS graduates were unemployed- 



prior to graduation compared to 36% of GED graduates . \In addition, twice 
as__many.AHS graduates (32% vs. 16%) received public assistance tni the; 
12 months before obtaining a dipl oma. Given these di screpanci es in soci o- 
, economic ci rcumstances,_bne~miglrt expect to find substantial differences Jn 
outcomes favoring the GED group. This was not the case. Only three, / 
statistically si gnif icant differences were observed. The first* related to 

*Data reported in Chapter 5 suggest that the overwhelming majority' . / 
enrolled in two-year community colleges. < . 
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public assistance, is not surprising in light of the initial discrepancies 
between the groups. The second is relatively tri vial and probably accounted 
for by the emphasis on civics in the typical AHS curriculum^ 'The third is 
difficult to interpret. . 



The two groups differed as follows: 

1; In the twelve to eighteen month period following graduation, only 
7; 9% of GED* graduates received some form of public assistance 
.compared to 26.3% of AHS graduates (X 2 = 14.8, df = 1, p = .6801), 

2. A slightly greater proportion of AHS graduates (76.6%) than GED 
graduates (61.9%) reported knowing more about how the government 
works since earning their diploma (X 2 = 5;1, df - 1, p - .02) 

3. _ A greater proportion of AHS gradates (90.0%) than GED graduates 

(70.4%) reported, that they a re/ now able to do thei r jobs better 
(X 2 * 4.5, df = IT p = ;03). 

Opinions . of Graduates 
Concerning GED and AHS Program 




Although hot directly related t o ben efits obtained by securing a ~l 
high school credential, graduates' views of the value of ^GED.ji v nd AHS 
programs are perti nent to "a general 'assessment of program e f f i c^yLa n d 
need arfd thus to the issue of "benefit" in its broad.sense- 

GED graduates were isked to rate their extent of agreement/disagree- 
ment with the following/statements. "Strongly Agree" was scored ,4, 
"Agree" 3, "Disagree" £, and "Strongly Disagree" 1. 

1. The classroom instruction I received was very helpful in preparing 
me to take the GED test. 

2. I would not have taken the GED test if the adult education program 

1 attended had/not been available. : ^ 

The mean score for the first item was 3.7 (SD - .93), indicating a 
strong degree of /agreement with the statement posed. For the second 
item, the mean was 3.2 (SD = .93), closer to "Agree" than "Strongly Agree," 
but nonetheless/quite positive. 

AHS graduates were posed the following equivalent questions using 
the same agree/di sagree format and scoring system. 

1. The adult high school I attended was very helpful in preparing me 
to earn /my diploma. . • 

2. If the /adult high school was not available to. me, I would not have 
earned/a diploma. 

the mean for the first item was 3.6 (SD - .68), "indicating strong 
agreement/ with the statement posed. The mean for the second item was 
only slightly lower (3.4, SD * .79). 
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It can be concluded that the great majority of GEO and AHS graduates 
placed a high value on the instruction they received, and agreed that they 
Would hot have earned their diplomas had they been denied access to an 
apprbpriate^dult education prograrfi. 

Section 2: Macro Findings < 

The findings below are based on the GED sample data. Technically, 
they can drily be generalized to the population of adults who passed the 
English version of the GED test between January land April 30, 1982, and 
who indicated on the test form that. they had participated in a state- 
sponsored- adult basic skil Is education program. For this sample, the 
standard error of measurement for inferences to population proportions 
is _+.3%i However, as noted previously, it is reasonable to assume, that . 
the January to April graduates were unlikely to differ significantly from 
the graduates who passed the test during the other eight months of fiscal 
1982. Thus, in projecting raw numbers , the 12-mohth adjusted total of 
3,056 was utilized as the base. /' 

Employment and Earnings Twelve to 
Eighteen Months After Graduation - 

An estimated total of: 

1. 391 (12.8%) obtained employment. /■ 

: ■ ■ ' - ■ - * ■ i ■ •/ 

2. 2,677 (37.6%) increased their earnings. : 

3. 587 (19.2%). obtained a better job. j 

4. 348 (11.4%) were promoted go the job. % / 

5. 1,008 (33.0%) reported they were more likely to keep their jobs. 

6. 1,008 (33.0 % )~f el tr"ttrey^/e r e-be4rtre r~ ab Te-'t o~~do t heir jobs. 
In regard to earnings: 

1 . Fo ;^grackja*e^ 

follow-up, the mean weekly increase in take-home pay was $66. 67. 

2. For graduates employed part-time both initially arid -at the time of 
• follow-up, the mean weekly increase in take-home pay was $28.33. 

3. For the total sample, the mean weekly increase in take-home pay was 
$29.87. This can be extrapolated ($29.87 x 52 weeks x 3,056) to a 
cumulative annual gain of $4,746,701. 

Reduced Dependence on Welfare and Public ; ■' 
Transfers Twel ve, to Ei ghteen Months After Graduation * 

1. An estimated total of 581 |i9.0%Jj were removed .from welfare arid other 
public transfer programs, such as Food Stamps. / ° 
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Investments In Human Capital Twelve 
to Eighteen Months After Graduation 

An estimeitebxtotai of: 

1. 953 (31.2%) enrolled in college. ' ; ~ 

/_...." ... 

2. 840 (27.: 5%) enrol led in a' job training program or a trade or 
technical school. 

3. 2,582 '(84.5%) improved their readi ng, writing, or math skills. 

.4 ; 1,953 (63.9%) reported they, now 'set a better example for their 
chil dreru - 

5. 1,892 (61.9%) reported increased knowledge of how the government 
works i 

6. 2,879 (94.2%) reported they now feel better about themselves. 

. Summary andJScmcl unions 



^ In 1981-82 there were 12,311 adults enrolled in adult high schools 
t^HS). Total state revenue to local school ~distri cts for AHS programs 
was $11.55 million. However-, only $2.38 milTiorfor $193.43 per partici- 
pant was actually spent on the AHS brograms at tbelbcal level * During 
the same_ y ea r_, t he re we re 18,175 pa rt Tci pa rit s in GED-targetedaduH basic 
skills programs. It was found that the state spent $2.19 million on these 
programs or about $121^70 per participants tocal districts reported 
spendi ng an additional $32.34 per parti ci pant. 

I n orde r to det ermi ne whether the benef i ci al effect iTof~these programs 
outweigh the cost to the state, a questionnai Ke aimed- at identifying the 
potential benefits of these programs was developed s "The questionnai re 
was administered to recent graduates of the state to 
determine if_ the hypothesized benefits of the programs were actually 
realized by the parti ci pents. r 1 . /. 

What we found in terms of benefits were the fallowing: 

. Participants in both AHS- and G^D -targeted programs 
- found the instruction t^ 
hel pful in preparing them" to earn their diplomas; 

. Participants agreed that if the programs did not 
exist, they would not have earned diplomas ; 

• Graduates reported gains in employment, increases in 
earnings, increased likelihood of keeping' jobs; and_ 
improved performance on the job after completing the 
program. / 
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. Graduates reported furthering their education beyond 
hi gh school , i mprovi ng thei r readi ng, writing and math 
skills, being better role models for their children, 
and greatly enhancing their self-esteem. 

The results of this study indicate to policymakers that state 
expenditures; on diploma -targe ted programs are viewed by graduates as 
needed and that these programs have positive effects across a wide 
spectrum of outcome measures. As stated at the beginning of this, chapter, 
it is difficult to place a monetary value on this array of benefits. 
Setting a value on increased employment, reduced dependence on welfare, 
further improvement in education, or benefits to the children of program ' 
graduates is a matter ok judgment and cannot be arrived at objectively .' 
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CHAPTER V 



OUTCOMES OF PARTICIPATION IN ADULT 
? BASIC EDUC ATION. 



Introduction 



The previous chapter was concerned with some of the same questions . 
addressed in this one. However, Chapter 4 dealt not Only with a different 
populationf but its purpose and focus were much narrower, namely, to 
analyze costs and benefits associated with New Jersey's high school completion 
program. Data on benefits were secured by a one-page mailed questionnaire • 
completed by GEO and adult high school- (AHS) graduates twel ve to eighteen 
months after obtaining their diplomas. It was assumed that many of the 
reported benefits were directly related to obtaining a high school credential. 

The /resent chapter, in contrast, reports the findings of in-depth : 
interviews with a random sample of ,294 ABE students enrolled between October, 
1982, and April, 1983. Although the emphasis of the interviews was^on^ 
.outcomes attributable to program parti ci pat ion° between October and April, 
attention was given to probing other aspects of students experiences, For. . 
example, questions were. asked concerning reasons for participation, perception 
of the educational process, and factors influencing discontinued attendance. 
The intention in asking these kinds of questions was to provide a broader 
context for analyzing and interpreting the findings related to- outcomes. 

The present chapter is organized as follows. The first section- provides 
a sociodemographic profile of the survey respondents. Next, findings 
related' to the "context" questions, such as those listed above, are^pres 
In the third section outcomes are presented in the following order: . 
(lj employment -related changes; (2) acquisition and application of basic 
skills; (3) further education and training; (4) reduced dependence on 
public assistance and (5). personal -and family effects. 

A detailed description of the methodology of this component of the 
study can., be found in . Chapter 3. , : 

• Characteristics of Respondents 

Data comparing selected characteristics of respondents with hon- 
respon'dents are reported in Chapter 3. Table 5-1 below presents^ fullep 
sociodemographic profile of the: 294 students who comprised the final samp e 
"for the study. The -relatively low proportion of Hi spanic respondents ref lects 
the decision to exclude English as a second language students from the study 
population. All Hispanic respondents were enrolled in regular, English- 
language basic skills classes. 




- Table 5-1 « , 
Description of Respondents, in Percentage * 

(N=294) 



Characteristic .- . Percent 



Sex 






* > 

Female 

Male N 




69.7 
30.3 


Raee/Ethni city J 




- 


Black ' 
White 

Hi^oanic / • 
i j \^ in* / j 

ether 




50.0 ' 
31.3 
13.2 
5.6 


Reading Level 






1 (0-3) 

2 (4-6) • 

3 ,(7-8) 

4 "(9-12) 




7T9- 
36^3 
34.6 
21 .2 


Empl oyment Status 






Employed 1 
Not Employed 




; 37.5 
62.5 


Age** 






16-20 
21-29 r 
30+ 




29.6 
31.2 
• 39.1 



, . i : — ! '—r : T 

♦Percentages may not add to 100 due to rounding 
**Mean age =30. 



Table 5-1 reveals that the majority of sample were women, minority 
group members, relatively young, unemployed, and reasonably -proficient 
readers. Although data on family -income were not obtained, it appears 
likely that most Of the respondents 'were economically disadvantaged. • 
This conclusion is buttressed by the fact that 26.6% reported receiving 
some form of public assistance. 



-Reasons for Participation 

- Respondents were asked to "think back to when you first, enrol led in 
the program. What were your reasons or goals for enrol li hg?" 

As expected, the majority gave more thdn one reason. Their answers 
were i inducti vely -coded i nto six categqri es: to get a dipToma/f i a hish 
schooling; to prepare for further education or training; -to get a job or 
better job; to .improve basic ski l is ; to enhance personal development /esteem/ 
confidence; and a catch-all n other" category. _B.ecause_ofL_the_1arge number 

" of multiple responses, thfc <jata generated by this question were judged to . 

be of little uti lity and are not reported here* What is reports 

Table 5-2 are the frequency distributions based on the fol Tow-up question, 

"Which arte of these reasons was the most important to „ou?" . - 

Table 5-2 ' J J • : 

Most Im^ortimt Reason for Enrollment, in Percentage 



(N=291 j* 





• Reason 

' . ' ■ v — : - 








i. 


Obtain Diploma/Finish School \ 


43.6 






2. 


Prepare for Further Education or 
Traimng \ . 


8.9 


f .; 




3. 


Obtain a Job or Better Job , 


18.9 






4. 


Improve Basic Academic Skills 


18.9 






5. 


Personal Development/Esteem/Confidence 


, 7.6 






6. 


Other "•. . 


, 2.1 







*In this and subsequent tables, cases with missing 'values are deleted. from 
the base N of 294. 



Although Table 5-2 may contain few surprises, it is noteworthy that 1 
the. majority; of respondents -did not identify obtaining a diploma or 
finishing school as their primary reason for enrollment. Moreover, in 
researchers 1 qpinion, an .extremely important feature of this_and_most of 
. the tables that follow is the meaningfulness or validity of the response 
categories.- As discussed, in the methodology chapter^- predetermined, fixed 

' responses were not employed in seeki ng answers* to[ complex questions «> 

» Instead* the respondents were allowed to answer in their own words, wh i ch 
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were then inductively coded to generate ; the response al ternati^es^ ^The 

reasons for enrollment listed in. Table 5-2 are grounded in the respondents 1 
own experience^ not in. the researchers 1 "expert opi nion." . 

~ - Jmpact: of : Change E vents 

-Previous research (Aslanian and Brikell, 1980; Knox, 19/7) suggests 

that the decision to enroll in adult education is often influenced or . 

"triggered" by life change events that heighten need or motivation to learn. 7 
This proposition was tested by aski ng respondents "Why did you enrol 1 at 
that particular ;ime? Was there something happening in your life that made 
you decide ta ><>*qll?" Nearly two -fifths of the respondents (39.1%) . 
identified ?pec^ fit changes in their lives that influenced their_ decision,/^ 
to enroll z < *BE. Of these two-fifths, 41% identified the need for a / 
30b or a better job as the precipitating factor, 33% mentioned family ' 
. changes (e.g., divorce, new baby, marriage, .death, empty nest), and 

26% said that job changes, both actual and anticipated, prompted their 

enrollment; Examples of such .changes included Toss of job, job insecurity, 
injury, and age-related decrements in physical stamina or strength. 

Expectations of ABE. Program ; 

Respondents were asked," "once you enrolled, was the adult education 

course what you expected it to be like or f was. it different?" The main :/ 

reason- for aski ng about expectations was to examine the responses of those 
who found the course to be "different." Was it different in a positive way 
or in some negative sense? It was anticipated that those who perceived the 
course as negatively different would. be more likely tp drop out and less 
likely to realize beneficial outcomes than other respondents. . , 

Nearly half t&e students (48.6%) stated the course was. what they had 
expected; 6% indicated uncertainty, and 45.2% responded that it differed 
from their expectations. Table. 5-3 summarizes the i ndurtively coded'; . 
responses of the 133 respondents who perceived the course- as different . 
X^s&y from what they had expected. 'X. 

v.>J ; ■ 

j \ The most striking figure in Table 5-3 is the large proportion of 
- students who . percei yed the course as characterized by more self-pacing and 
individualized instruction than had been expected. Clearly, the majority 
saw ABE as different, in positive or "neutral" (e.g.desree of difficulty) 
ways from what they had anticipated. Not^enough attention, not enough 
structure, and tod much structure might be considered "negat i ve differences ; " 
However, the "negatives" total led only 23 respondents, too* few to use 
"negative 'differences in expectations" as" a variable for subsequent 
statistical analyses. - 
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-Table 5-3 . / , • ■ 

■ / • ■ ' • 

Ways In Which Course Differed From Expectations in Percentage* 
- ■ " : (N=133) ' / 



i . - ' ~^ — ~ ; ] ' ' : - ' j 

/ Ways Course Differed percent 

:: More Personal Attention 12.9 

. Sel f -Pacing/ Individualized Instructibri 35*3 

Easier Than Expected 6„8 

Harder Than Expected ; 6.1 

Not Enough Person al Attention 9,1 

Not Enough Structure 9.1 

Too Much Structure — -■ 2 V 3 

Other Answer . 23.5 



♦Percentages da not add to inc due to rounding 



• • Problems Related to Success in Ct as^ 

* * * .t 

For purposes similar to inquiring about the nature of differences in 
expectations, respondents were questioned about the extent tp which 
certain factors impeded thei r success in. class. A scale {called PROBDEXj 
was 'constructed in anticipation that students who experi ehced di f f i cu Iti es 
in the classroom (i .e., scored high on the seal e) wou 1 a al so experi ence 
negative outcomes related, for example, to dropout and goal achievement. 
As reported subsequently, to some extent this hypothesis proved to be 
correct. : Table -5-4 is based on responses to the following question: "Now 
I'd like to ask you about some problems adults often experience in going 
to classes. After I read each statement, please tell .ae if it is very, 
true, somewhat true, or not true." -~ 

• ' i; y'X • • .; I ■ ' ■ ■ 




< Table 5=4 

Extent To Which Respondents Experienced Class-Related Problems, * 

in Percentage* 

• • (N=294) .." : ? , 



b. 



e. 



Problem 



Extent True 

Not Somewhat Very 
True True True 



You didn't feel you were making enough 
progress toward your goals 



You didn't receive enough help or attention 
in class 



47.3 



67.3 



The classwork was harder than you. expected ' 62.2 

71.4 



d. You didn 't get support or encouragement 
from family or friends 



You had trouble attending class due to 
job or family responsibilities 



48.0 



39.1 

20.7 
28.6 

17.7 

26.9 



13.6 

12.0 

9.2. 

11.0 
25.2 



♦Percentages across rows may not add to 100 due to rounding 



ERIC 



Although, in general , few respondents agreed that the problems listed 
were "very true" for them, a substantial number indicated difficulties _ _ 
related to making progress toward their goals and. attending class regularly 
because of job or family responsibilities^ Othe r research (e.g. Mezirow, 
Oarkenwald, and Knox, 1975) has identified these/problems as particularly 
prevalent in ABE programs. ' f> : '■ ; • 



Two open-ended follow-up questions asked respondents to identify any 
other jjn fcortant problems they had and to indi cate which single problem they 
considered most serious. -The responses to the "most serious problem" 
question are shown i n- Table 5-5 below* 

It is noteworthy , that the majority of problems identified as most - 
serious were external to the program^ that is, life-situational. However, 
perhaps most significant is -the relatively large number who stated that 
their own shortcomi ngs as learners constituted thei r most, serious problems. 
Undoubtedly, much of the self -blame is justified, , but "difficulties in 
Teaming" to some degree reflect def, i cienci es in teaching. 
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Previous research (Mezi row, Darkenwald, and^ Knox, 1975] suggests that ABE 
students are extremely uncritical of their teachers and almost invariably 
blame themselves for thefr academic shortcomings and failures; In any _ 
event, when a third of the students express outright dissatisfaction with 
the program or indicate that they have difficulties with learning, program 
personnel should be concerned. 



Table 5-5 

./-... . . ■ — ■ • 

^Problems Identified As Most Serious Or Difficult, In Percentage* 

. (N=223) 



Problem 




Percent 




Work -Related Scheduling Problems 




18.0 




Chil dcare Responsibi 1 i ties/Problems 


9.9 




Family Problems (e.g. , mari-tal , 
lack of support/encouragement ) 


illness, 


16.1 . 




Transportation 


7.2 ' 




Health r(eigi , drugs, drinking, 1 p 
mental illness) 


Nysieal and 


5.8 




V 

Dissatisfaction with Programmes 
methods, curriculum) 


g* teachers y 


15.2 




Difficulties with tearhihg (e^g^ poor progress, 

poor study skills; lack of self-discipline) 

i 


17.5 




Other • 




10.2 





♦Percentages do not add to IBB due to rounding 



Attendance rates ,and attrition^ (dropout ] can be considered outcomes of 
participation in ABE, las well as me factors that influence other 

outcomes, especially ^Benefits " $*ich as extent of learning and personal goal 
attainment. This section focuses on rates of attendance and dropout, and 
reasons for dropout or "discontinuance." - P - ~~7\ 

Emphasis is given to the distinction seldom made in dropout research 
between "positive" and "negative" di scontinuers . The former group comprises 
persons who drop out because they achieve' thei r objectives for enrol ling* 




In contrast, the latter group consists of iridfviuduals who drop but for 
reasons such as personal problems, lack of motivation*; or dissatisfaction 
with the educational program. Unless this distinction is made, :it is 
impossible tbcompute the negative or true, dropout, rate^ which is bf_ 
special significance because of its widespread use, as an indicator of 
program* effectiveness and efficiency; 

Attendance Stati sti cs 4 . 

Before discussing di scontinuancei jt might be noted that class attendance 
dropped sharply from October to _March (the ^months _f9 r whicS. data were 
obtained). Average hourly class attendance by month Was 32;2 in October, 
25.8 in November, 13.0 ip December (when most programs curtailed classes), 
13.7 In January, 12.5 in February^ and _15.2 : in March. _: Of course, monthly 
attendance, figures , i as time passes, tend to be depressed by the usual - 
practice of including everyone officially enrolled, even discontinue^., in 
the calculations. 



In April y respondents were asked, "Are you still attending the adutt 
education class or*nave you stopped attending? 11 One hundred fifteen, or 
39.1%, indicated they were still attending, compared with 1 79 or 60.1% who 
said they hadjstopped attending. Of those who h§s ceased attendance, 45^2% 
said "yes" an/J 41 .6% "no" when asked "Do you plan to start class again later 
this, spring dr next fall?" - the remaining 13.3% stated they were "uncertain." 

It is l/ighly probable that the figure for those^who planned to return to • 
class, is Wf latedi especi ally when one considers that only 17.8% of the 
sample were "carryovers " from previous years . 

Real ons for Discontinuance 

A gross annual dropout rate of 60% may seem incredibly high, but it is 
quite consistent with* evidence from numerous other sources, including 
nationwide surveys (Development Associates, 1980; Kent, 1973). As noted 
above, however, gross dropout statistics can be/extremely misTeadi ng* for 
they fail to di stinguish "positive" from "negative" discontinued; In the 
present study., this distinction was accomplished by asking all. respondents 
who had stopped attending why they did so. Their answers were then inductively 
coded and interpreted as indicative of either positive or negative ■ 
d, scontinuance. Table 5-6 reports the results. ~ : 

Inspection of Table 5-6 reveals that nearly half of 'the discontinues 
were not dropouts in the conventional, negative sense In fact , 

nearly one-fourth earned their high school diplomas. 



If ; 
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Table .5-5 • _ . 

Reasons Given for Di sconti nui ng Attendance, in Percentage 
. /■ (N-176) 

Reason 1 ■ Percent 



Work Schedule Conflicts 11.9 ; ; 

Child Cane Problems 6.3 

Family difficulties > 1 ,8.5 

Health Problems - ' 5.1 

Dissatisfaction with Program. . 8.0 

Earned Diploma 24.4 

Entered Job Training program 11 .9 

Program Ended or Course Completed 10.8 

Other " N . 13.1- / 

One would think that official 'records would reflect such. f|cts and 
that all positive terminations would be so identified. in practice, however,* 
there is no systematic way of identifying all or perhaps eveh most positive 

terminations. To illustrate; fewer than 20% of students who takeHhe GEO 

examination provide the GED testing centers with the necessary information 
so that exam performance can be reported to the instructional program. Even 
when such information is communicated, it may be received, after instruction 
has terminated. L i k ewi s e ^^-frdfetits- who nave entered a training program may 
simply stop attending class without informing their teachers or counselors of 
the reason why. In short, few programs- have developed a cost-effective 
student follow-up system that would n^o I ve these kinds of problems. 

Supplementary. Findings * I 

A question of obvious interest is what factors account for or predfct the 
phenomenon of negative dropout? Using exploratory correlational procedures 
and multiple regression-analysis, two statistical ly significant .predictors* 
were, identified. One, not surprisingly, was total hours of class attendance 

(B »' -.29, P = .0007). As the negative st anda rdi zed - pa rt i al correlation y 

coefficient indicates, negative dropouts (scored 0) were characterized by lower 
class attendance than were positive dropouts (scored 1). The second (Beta) 
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edictor, again dot surprisingly, was the PROBDEX scale described in Chapter 
(B = .36, P = .0001). Those participants who experienced more problems 
e.g., lack of progress, not "enough help in class, lack of suppprt~frOm family 
r friends) were more likely than others to be negative* dropouts. Taken 
ogether, these variables accounted for 25% of the variance associated with 
dropout. 



Employment -Related Outcomes 



As can be seen by inspect'!. .m. of items 10 through 13 of the "Adult Education 
Fol low-tip Survey" (Appendix A), the questions dealing with employment-related 
outcomes were both n umerous and. complex. Rather than present the data in a 
series of discrete tables, it was decided to summarize the principal findings 
in outline form in the section below. * 



1. 



2. 



3. 



4. 



5. 



6. 



7. 



8. 



Hating to Employment 

At -the time they enrolled in an adult education program, 37.5% of 
respondents were employed. At the time the survey was administered, 
50.0% of respondents were employed. Thus, there was a net gai n in 
employment of 12.5% ^ 

Twenty -three percent of the respondents were unemployed and not 
seeki ng employment, and thus were not in the labor force. For those 



who were in the labor force, the net gain in employment was 16.4%. 

Of respondents employed at the time they entered the adult education 
program, 18.2% changed jobs- by the time the survey was administered. 
Of these,' 61 .1% reported that they had found a better job, 38.9% a job 
that was "about the same," and 0% a worse job. 

Of respondents employed at the time, of the survey, 64.8% felt' that 
their job performance had improved during the previous six months. 

Of respondents employed at the time of the survey, 41.8% had obtained 
a raise during the previous six months. 1 

Of respondents employed at the time of the survey, 14.2% had been 
promot ed during the previous six months. 

Of respondents employed at the time of the survey, 56.7% felt that 

their job security had improved during the previous six months. 

Of respondents unemployed and seeking employment at the time of the . 
su rvey , 78.8% believed that their participat ion i ri adult education ; 
woul d help' them find a job. . f 



I- 



to 



have 



been 
be 



In general , employment-related gains or benefits appear 
modest, but_by_no. means insignificant. The extent to which they can 
attributed to participation, in adult education, however, is problematical . 
It was discovered early in the interview process that nearly al 1 the 



respondents interpreted the "attribution" question ("Bid bne adult educat~io?r~ 
: program help-. . ;?" j extremely literal l^ : ..^wIp M _was interpreted to meVn ^ 
direct assistance in obtaining a ^jpV"or bBttep_job; indirect f owns of help 
such as enhanced skills, qualif i cations, nioti yat ion or self-conf id 
* simply did not come to mind when this question was asked; Consequently, the 
responses fid these items were discarded as invalid; /; 

On logical grounds, however, it would seem that certain positive outcomes 
;_ could not be expected in the absence of some form of relevant intervention; 

This would seem part.icuarly true of the -f indi rigs that nearly two-thirds of 

those employed at the time of follow-up felt their job performance had improved 
and more than half believed they were more secure in their jobs*. 



. Acquisition and Application of Basic Skills 

For the majority of participants, the outcomes reported in this section 
constitute the. "bottcsti line." The reason, of course, is that adujt basic 
education's pri ncipal purpose is to upgrade the basic skills of ftinctional-ly 
illiterate adults. Enhancement of basic skil Is is not, however, an end in 
itself. Rather, the three R's are intended to be appli ed to meeting the 
literacy-relat ed demands of everyday life. They also enhance access to educational 
and economic opportunity - particularly in the form of eligibility for job 
traini ng programs and other forms of further education. - . , 

It is important to note regardi ng outcomes that a substantial minority 
of basic skills students cannot be considered severely educationally handicapped. 
These are the "level fours," (21.2% of the sample) whose reading, abil ity ranges 
from grade 9 to grade 1 2. Presumably, most "level fours " are preparing to^ take 
the GEO test and require relatively little basic skills remediation. Fur them, 
the "bottom line" is passing the test, hot acquiring and applyi ng literacy skills. 
Their responses to the acquisition and application questions, consequently, " 
might be expected to depress the proportion reporti ng positive outcomes. 
Statistical analyses revealed that such was the case — to a modest extent — 
for the application questions, but not for the questions on acquisition of 
knowledge and ski lis. - '■ 

Respondents were asked a series of four/pa ral lei questions regarding 
acquisition x and application of knowledge ana skills related to . (1 ) reading, . 
(2) writing, (3) math, and (4) "other things 11 learned. The results are reported 
separately below for each of these four categories. 

. . . — r * : 

Readi ng * •; — — ; •' ' — - \ — ' 

.-; In response to the question* "Has the adult education class helped you 
become a better reader?", 82.8% answered "yes " and 17.2^<qo." Respondents 

— v/ere--then--askedi- JI Si nce-enrol.li ng i n the class, hajve-you-used-your-readi ng— ; — — 

skills outside of the classroom to do somethi ng you couldn't do before, or to 
do it better?" Nearly two-thirds (65.1%) responded affirmatively. They were 
then asked, "What are some of.things you have done or can. now do with your 
reading skills?", followed immediately by a standard "probe": "read; recipes, 
want ads, the mail , magazines, things like that?" One hundred fifty-eight 
respondents reported a total of 345 ways in which they applied their improved 
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reading ski] Is. _ Their answers were inductively cbdedintb the seven catergqries 
shown in Table 5-7. _ The percentages represent tie frequencies in each category 
divided by the total for all categories, that is, 345; 



Table 5-7 

Application of Reading Skills Outside the Classroom 



Application - Frequency : Percent* 



Read Newspapers . 


77 


22 




Read Magazines 


70 


20 




Read Books 


74 


21 




Adverti seme nts 
(employment and consumer) 


39 


11 


\ 


dbb Readi ng 


22 * 


6 


v. 


Recipes , ; 


19 


6 




Mail 


15 


4 




Other 


29. : 


8 




Totals 


345 


98 





^percentages do not add to 100 due to rounding 



It i s clear from Table 5-7 that a majority of respondents applied thei r 

improved readi ng ski lis to the traditional pri nt medi a ~- sources of both 

information as well as entertainment. The number applying thei r enhanced 

ski 1 Is to job-related readi i na t;asks* is more substantial than the table suggests 
when one considers that more than half the sample were unemployed^ The 
figures for advertisements, maiU and recipes are especi al 1y indicative of 
application of skills to rudimentary tasks of a "functional , 11 everyday. 
- nature. ' . 

Wr i ti . 

Because writing is given less emphasis than reading or math in most basic 
skills prpcjramsj it is not surprising that only 62*6% of the respondents 
indicated that the class hel ped them to wn te bett use of 

writing skills outside the classroom was reported by a relatively modest 49.4% 

u 
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gf those interviewed. This group was then asked, "What. are some_things ycfe * 
have done or can do nw with your, improved writing skills?"* followed 
immediately with the ^ibei "fil/1 out forms, write letters or notes, thing* . 
like that." One hundred 1 twenty-four respondents reported a total of 186 
ways in which they had applied thei r improved writi ng skills • 'Their inductively* 
coded responses, with frequency and percentage distributions, are reported in 
Table 5-8. - - 



Table 5-8 . 

Application of Writing Skills Outside the Classroom 



i cat i on 



Frequency 



f*ercent* 



Letters and Ngtes 

'Forms (e.jg. , applications , checks, bank forms) 
Job Writi ng. (e.g. , notes* memos* resumes) 
Creative Writing (e.g., poems* stories) 
Other 



88 
54 
24 
8 
12 



47 
29 
13 
4 

6- 



Totals 



^percentages do not add to 100 due to rounding 



99 



Not surprising, writing letters and notes were the most frequently - 
mentioned ways, in which respondents applied their improved writing skills. 

dob writing, like job reading, again ■ emerged as-a si gnificanc, category, 

•especially in view of the' fact that roughly half the study sample was unemployed. 
Completing forms of various kinds was mentioned by i substantial number of 
those interviewed. Finally, a few blithe spi hits reported that they had 
begun writing poems and stories. * 

Mathematics 



Eighty-five percent of the respondents indicated that participation i l n 
adult education had helped them to improve their math skills. In regard to 
the application of skills outside th^/classroom question, 58.3% responded in _^ rr . 
the affirmative. This group was then asked to describe some of the things they 
had done with their improved *math skills. One hundred forty respondents 
reported a. total of 229 ways in which they had applied these skills. Their 
responses are shown in Table 5- Q - 
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fable 5-9 

Application of Math Skills Outside the Classroom 



Application Frequency Percent 



Consumer Math (e.g., price comparisons ~, - j — 

discounts, sales tax) 74 . j 32 

Job Math (e.g., measurements, cashiering, -- 

inventory) , 1 *5 20 

Checkbook and Bank Transactions 43 i j 19 

Personal Money Management (e.g., budgets, 

tax forms, records) 37 ; 16 

-_ - - -- ! 

help Children with School work 16 j 7 

Other I-- ^ 4 j 6 

: totals 229 i 100 



J. 



The findings in ; Table 5-9 reveal a variety of appl ications of matji 0 
skills to the demands of everyday 1 i.e. Again, it should be noted that the 
frequencies in r the job-related category are less than they would be if the 
majority "of the sample were employed. -The category H help_children with \ 
schoolwork" is similarly affected by # the fact that more than half of the 
respondents had no children living at home. 



ming 



The last question posed in this section inquired about other- learni ng: 

"Aside f rom reading, writing,^ and math, were there .any other things you 

learned in the adult education class?" The 51 .9% who responded affirmatively 
were then asked "What other tHMgs?" Their responses are shown in Table 5-10. 



] 
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Table 5-10 

Other Learning Acquired in Addition to 3R's 



Other bearni ng 



Frequency 



Percent 



9 
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•Social Studies 

Interpersonal Skills (e.g., relating to 
others, communi cati ng better) 



Sci ence 

Learning to tearn (e.g. , sel f-di rectedness , 
study skills, self-disc Mne) 

Self-Development (e.g., confidence, esteem, 
sel f-di scovery) 

Home Economics (e.g.., nutrition, chi-ldcare) 

Job-Seek i ng Ski lis 

Other 



47 

36 
18 

13 

12 
10 
8 
38 



26 
10 



7 
5 
4 
21 



Totals 



182 



100 



Some of the findings in Table 5-10 are predictable and easy to e: 
Social studies "and science, for example, are routinely included in the 
curriculum far "upper level" students preparing for the GFD; test. In addition, 
social studies (specifically American history) is required by state law to 
earn an adult high school diploma. Similarly, home economrcs and job-seeking 

skills are frequently -included in "life-skills" components of the standard 

curriculum. In contrast, self -development, interpersonal skills, and learning 

how to learn are seldom part of the formal curriculum. Instead; they are 

• indirect outcomes of the learning process - outcomes whien for soi-.e parti ci pan 
may be equally or more important than those explicitly included in the 
curri culum. , >r 

, Supplementary F J 



Exploratory correlational and multiple regression analyses *ere employed 
to identify predictors of both the acquisition and application of basic 
skills. As expected, acquisition and application (as measured by summing the 
"yes" answers fr* the relevant questions) were themsel ves substantially 
correlated (r = .64, p = .0001 ). Thus, it was not surprising that both 
these measures were associated to a modest, but statistically significant 
extent, with the same predictor variables. •; 



of 



8* 



7.9 



These included total instructional hours*, perception of the class as differing 
from expectations in a positive way, ahde/teh i which the class facilitated 
attainment of individual goals for enrolling* -owever, : wheri these variables 
were controlled in multiple regression equati oris - 9 only, hours of instruction 
emerged as a statistically significant predictor (B ='.25, P = .0,001 for 
acquisition; B = .22, P = .03 for application). 



Attainment of Personal Goals . 

$ : ■ " '■ ~ ! 

As can be seen^frdm Table 5-2,_ basic ski lis students enroll for * variety 
of reasons, not al 1 of; which directly correspond to the goals of tr.s 
instructional program. Those that do not can be viewed as ultimate or terminal 
reasons for participation that are facilitated by the acquisition of reading, 
writing* and computation ski! Is*. 

Whether directly or indirectly related to the instructional program, 
individual goals are obviously of the utmost importance. In order to ascertain 
the extent of individual goal attainment, two questions, one "subjective" 
and the other "object i ve," were posed to all respondents. 

The subjective! question was put as follows: "Thinking baCK to your > ! 
reasons or goals for enrol ling in the_adu It education class, has t^e class 
helped you to reach ther totally, a 1ot,_some, a little, (or) not at all?" 
Of the 294 respondents, .4% answered "totally," 48.6% "a lot," 25.7% "some," 
9.6% "a little," and 2/ hot at all." Clearly, a substantial majority felt 
that their learning ex -6 *^es contributed significantly to helping them 
attain* their '.goal (s J* 

Because obtaining a BED or adult, high school c^ploma was by far the most 
frequently stated goal for enrolling in adultieducation (stated as most 
important goal by 43.6% of the sample), the ."object iye !! question asked, "bid 
the class help you pass $!>c 1 9ED exam or earn an adult high school diploma?" 
Twenty-one percent respbndedVaf n rmati vely, 67% negatively, and 12% said 
they already had a high school : di pi oma. . Excluding the latter 12% on the 
grounds that prior possession of a diploma is irrelevant to the issue of 
program outcomes, the adjusted figures indicate that^ diploma 

and .76.2% did not. Thus, over a period of approximately seven months, nearly 

a fourth of the sample succeeded in obtaining a high school credential . It 
shoiilfi be noted, rorr oyer, that this figure Gnderebiimates the annual 
frcpt tion of basic rkil Is students who earn a secondary level credential . 
Th* interviews were conducted in April, and thus the data do not include thoss 
students who passed the SEc test later in the spring or who passed, but had 
not yet received confirmation from the testing service. In addition, not 
all adult iMghschoo i Stuaents knew in April if they had successfully completed 
all requirements for o June diploma; ' 



- • - Furth er— Edu^atian and Training 

% major function of adult basic skills programs is to prepare participants 
fo»* further education or training. Respondents were <Kked, "Do you plan to 
enroll in any kind or; training or education program in the near future — say 
within 6 months or a year?" More than three fifths (62.9%} responded 
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af firmati vely ; 18;1% said "no," and the remaining 19% stated,,they were 
"uncertain;" Those who answered affirmatively were asked. "What do you plan 
to study?" Their responses are given in Table 5-11. -' — - 

<• . , 

■ fable 5-n , 

Further Education: Subjects Respondents Plan tp Study. 
. ... (N * 151) ■ . 

• " ' .\ . . . 

Subject \ Percent 



Computing (e.g., key punch i rig ; data entry, 

prpgramnri ng) 19.9 

Secretarial Studies (e.g. , clerk typlitr 
medical or legal secretary) 17.9 

Allied Health (e.g., LPN, RN, dental assistant, 

lab technician) 1 7 .2 



Business (e;g,, bookkeeping; accounting) ^ 7*3 
'Other - 23.8 
Uncertain , . - 13.3 



Table 5-11 indicates that the great majority plan to study' sub-profession!, 
yocatjc-ial subjects. Only a handful! of those interviewed planned to pursue 
an arts^or science di iciplinei or to prepare for a careen in law, teaching, 
social wor^, or any other f 1 eld^ requi-ri ng a bachelor's or postgraduate degree. 
Those whocr) answers fell in the "other" category, alm^t invariably mentioned 
a vocational or technical subject,; for example, j^eftromxs , auto mechanics,, 
hai i rdressing, carpentry, . plumbings and the like. , For most, jthese modest but 
worthy v career aspirations reflect a healthy realism; However, as previous: 
researchers have suygested (Mezi row, parkenwald, and Knox, 1975:), some, if on./ a* 
small Minority, are probably selling themselves short. 

Respondents planning to continue- their education were asked not only what 
they planned to study, but where. Not surprisingly, nearly a third (28,7%) 

were uncertain, often mentioning two or three possibilities; Of .those who — — 

had firmer plans, as Table 5-12 shows, most mentioned a local community college 
or public vocational -technical school; . 




. 81 : , 

table 5-12 

Further Education: Where Respondents Plan to Study 

(N * 151 ) 



♦ Type ' of Institution Percent 



Two-year Community College^.' v 22W 

' ' ^ ' _ ' 5 .. .. , 

Public Vocational -Technical School 18.7 

Four year Col lege 1U3 

Proprietary Trade or Vocational School 6.7 

Other 12,0 

Uncertarri ° 28.7 



\ Deperideric n Public Assistance * 

If adult Lasic skills programs help peoole to get jobs, better jobs, 
or promotions, then it fo'Vows that participants, over time, should 
txrzome less dependent on publ ic assistance. To test this proposition, 
respondents were asked the following question, which was consciously phrased 
to "de-stigmatize" receipt of puftlic support: /'Many people these days are 
receiving piibilc assistances such as ADG or food stamps. Have you received 
such assistance at any time during the- past year?" \More than one-fourth - 
{26.6%) replied i 4:hat Ihey had received some form of public assistance. They 
were therijasked* "Since October, has the amount of assistance decreased, 
remained ab cut the/same, or been totally eliminated?" Roughly two-thirds 
(67,1%) reported that ~.ie amount had remained about the same, 18.4% that it 
had decreased, and 14.5% that assistance had been eliminated. Finally; 
respondents who indicated a decrease or elijfto^tibri of public support were 
asked why: "Has the reduction. due to your getting a job, ?qiu making v 
more money, or to something else?" Close to half (43.5%) stated that the 
reason was getting a job, 8.7% mak i rtg rare money, and 47.8% "something else " 
It seems probable tfet the "so^ \Y\ i 3 else" answer, in 3arge part, reflected 
cut-backs in benefits arid a tightening of eligibility requi r^crts at the 
time the research wss ebrdiiet*d. In any event, it is significant rhat 
more than half of ' the -cclucf'.bn in public assistance can be attributed to 
respondents 1 gaining >mpl oynent ^r iricreasi rig thei r income. 
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■gersoh-'al arid Family Effects 

This 'action focuses on indirect outcomes of participation in adult 
education rieTated tjo changes in feelings about oneself and effects on 
parent-child interaction and child adjustment in the domain of childrens' 
school i ng, . . 

Affective . Outcomes , : • - ■• \ ■ , 

" Respondents were asked, "In general, do you feel better about ycursel f , 
thp same, or worse as a result of attending the adult education program"? 
A strikingly high 92.1% replied "better"; 7.2% said "the same." Virtually 
rib brie (0.7%) Indicated feeling worse. The 92.1% who responded that they 
felt better were asked to specify "Why or in what way do you feel_better 
about yourself?" Their inductively coded responses are shown in Table 5-13. 

, Table 5-13 

Reasons Given for Feeling Better About Self as a Result of attending 

Program, in Percentage 

(N-256) 



Reason Percent 



Personal Accomplishment (e.g., met challenge, 

made progress, achieved personal goal) 38.3 

Academic Achievement (improved reading, map, 

writing skills? - . M ; ^ 24.4 

Enhanced Sel f-corif itfence/Esteem \ 24.1 

Or eat? r Economic Opportunity 8s 3 

Sread r Educational Opportunity l 2.6 

Other , 2.3 



It is perhaps surprising, *nrt certainly noteworthy, that academic 
ar'ievement, the outcome iridst U recti y related to tfc? instructional program, 
was cited by only a fourth of the students as the <;eas;* why they felt . 
better about themselves. In contrast, more than twq-tifths cited indirect,^ 
affective reason. namely, enhanced sel f -confidence or $?\ f-esteem and 

,tfie psychic rewards of personal accompli shment. In view of the generally 
N o-ver levels of s?"! f-^tee?, sel f -confidence, arid tangible accomplishments 
v \«*q this population, these affective outcome, t?<e on special significance: 
Mornyer, they are riot only valuable as ends in t .emsel veis, but as jweans or 
nec6,--ar ; ' randitioris for eontiriuirig persor>l grevth arid accomplishment, both 

"academically and in the world outside the classroom. Finally, the responses 
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tdjthis question i eari be yiewed as expressions: of underlying .psychological 
ani^educational needs seldom overtly articulaterd by undersducated adults, 

Effects Related. to Chi Idren in School ; ; 

Respondents were asked if they had school-aged children or teenagers 
living with them at home. Those who did (45.4%) were then asked, "Has 
your participation in the adult education class resulted in any of the 
following changes? 11 A series of questions were then posed in a yes/no 
format. The results are depicted in Table 5-14. ( 

r Table 5-14 : . 

Responses to Questions about Children and School , in; Percentage 

(N = 129) 



Question 



Response 
Yes No 



% _ j- _ - . ■ _ ■ ____ 

Do you help the chil dren with thei r schoolwork more 
than you used to? 

Do you tal k to them more than you used to about 
school? 

Have they devel oped a ^ " z er attitude toward 
sr.hoo 1 ? , 

Are they now ^c-:tfng better g v ; ? ?.s? 

Have yo-i become uore involved with the schdol y for 
example by attend! ng meetings or other activities, 
or talki ng with teachers? 



75.4 


24.6 


81 .4 


18.6 


72,7 


\p.3 


,4.3 


25.2 


49.6 


50.4 







The potentially enormous import of the findings reported $"ti. Table .5-14 
is self-evident, in fact, they are so striking that one's immediate reaction 
: may well be to doubt their credibility. Certainly the questions posed, \ 
'especially the first two and the last, are of the type likely to elicit social 
response bias. On the other hand, a high proportion of "yes" answers might 
be expected •from .1 sample of parents who not ,o..ly chose to return to "school" 
themselves bu ; t|V?ho are actively involved in learning. Virtually all parents 
voice suoportnMSr pious sentiments regarding the importance of education; 
however *' acting *n the Usis of such sert'rrents i s^'lemonstrable evidence of 
true conviction. Finally, the pattern of "yes" re- ^nses seems to support, 
the credibility of the data in 1>ble' 5-14. Of not ere is that the large.*t 
proportion of "yes ,: responses were ei feted by the ,. 1 stion having to do with 
talking more to one's children about school. Not only does xhU behavior 
require llti'S effort on the pa' i" of the parent:, but it is difficult to see 
how it 'g'uTd--be avoided if only because cJiil-dren, seeing their parents "going 
to school ," would be likP 1 " to initiate sucfi^discussion. in contrast, 
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question on becoming more involved with the schboU attendi rig. meetings .arid 
so bnY elicited by far the smallest proportion of ^ves^ariswersi Obviously ^ 
the behavior in question not only requires parental initiative and effort, 
but in many cases would evoke psychological resistance or even fear due to 
negative past school experience and lack of self-confidence in .dealing with 
"experts" or authority, figures. Finally, in regard to the first question, 
a significant number of parents told the interviewers that they and their 
children helped each other with their, schoo] work. 

Single Most Important Benefi t of Parti cipati -o^ 

The final question posed to respondents was worded as follows: 'Taking 
everything into account* what is -.tjife one most important benefit you gained, 
from participating in the adult education class?" Their inductively coded 
responses are shown in Table-1 5, i 

Tatvle 5-15 . 1 • 

Single Most Important Benefit Gained from Participation in Adult 

Education, i n Percentage 

(N = 279) 



Benefit 



Academic Improved (e.g.* reading, writing, m 
grammar, study skills) 

Enhanced Sel f-conf iderice/Est .m 

GEO or Adult High School 'Diploma 

dob-related Benefits (e.g., qualified for training, 
obtained better job^ improved job skills 

nhanced Interpersonal Skills 

Other 




Perhaps the most striking finding in response to the "one most 
important benefit 1 ' question is the large proportion of respondents, who at _ 
reported indirect, affective outcomes related to enhanced sel f-conf vdence^ 
o; self-esteem. The significance and validity of these, affective outcomes* . « t :. 
are bolstered by the large proportion of respondents who g^e similar 
answers to the ques^'^n concerning reasons for fjasli'Bg better Uuout oneself 
as a result of participating in the program (see Table 5-13). In fact, ^ _ 
although by no means identical, there is a considerable degree of parallelism 
in the answers to these two questions. ' 4|# 



■ f 
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Direct outcomes of instruction, including proved academic skills and 
ny 3 high school credential , constituted the 'most important benefifcf^ 



of participation for approximately Sial f of t'fra sample; However, while 
nearly a. quarter of the respondents -eporcod earning a GED or adult high 
school diploma* biily 10% stated that earning a diploma was the single most 
important benefit of parti ci pet tori* On the face of it, this discrepancy 
app>^rs puzzling iri'the extreme. Bui is it really a puzzle? Would middle- 
class educators or researcher^ be surprised if a survey revealed that 
earning a degree was not mentioned : by the majority as the single most 
important benefit of attending college? if^there a puzzle, it lies in 
our perceptions, or mi ^perceptions, of the motives and needs of undereducated 
adult learners. 
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CHAPTER VI 



OUTCOMES AND IMPACT FINDINGS: 
CONCLUSIONS AND IMPLICATIONS 

- Introduction * : / 

The fbcu's of this chapter is on the meaning and import of the findings 
from the two follow-up surveys* What are participants and graduates t el ling 
us about the nature and value of their experiences in adult education programs? 
How do the findings of this study compare with those of other large-scale 
follow-up surveys? Are the participant perspectives and outcomes congruent 
with the stated purposes of the Adult Education Act arid state-level program 
priorities? What can we conclude about program "impact " on individuals and 
society? These are the principal questions addressed in the present chapter. 

What Are Participants jelling, Us? 

As noted in previous chapters, a distinctive- feature of the telephone 
survey was its extensive Use of open-ended question? in_order to give 
respondents full opportunity to "have their own say 1 ." They told us a great 
deal , including many things that surprised us. , This section emphasizes the 

important general messages , not the statistical/specifics. 

z 

Reasons for Participation / - 

__ - - ^ /_ - - 

Very few participants volunteered^only /6n<i reason for participating in : 
#BE. Most mentioned several goals or possible benefits, which indicates that 
Yh^y perceived "the program as educational I in tfi.e general sense of the word, 
not sfmply as a means to some pragmatic end sucH as a better job or* GEO 
diploma. To illustrate, when forced to give their single "most important 
reason" for enrol li ng, participants ' responses split evenly between obtaining 
a job or better job and improving their academic skills. For many, of ^ 
course, obtaining a diploma or "finilhing school" was a paramount 
The geieral message seems to be that Individual s enrol 1 in ABE for a var^ty**£ ... 
of reasons, some narrowly ut 1 1i?.aria'R *^d some not. It is- hard to see any »_ ' £ 
fundamental differences between the motivations of this populeit^on and those L 
of more advantaged adults who return b: college. 




Employment -Related Outcomes 

Those respondents who were unemployed and seeking employment appeared, 
to have benefitted from their participation in ABE, The data need to be, • 
interpreted cautiously, however, sinr,e gains in this area cannot be cortf idently 
attributed solely to the -program. The net ^vin in employment for the telephone 
survey sample, three-fourths of whom ):ad not earned a diploma in the seven-month 
interval between enrol lwent follow-cp, was 161; In contrast., the \-?t 
cjjslri for GEO and'adult hioh school graduates 12 to 18 months after earning 
their diplomas was Although the time differential and the persistence/ 

abi 1 : factor almost certainly contributed to the graduates' gre^var g^irs, ^ 
the difference is so Ta r ge that wt! ar^ led to conclude that the "credential 
effect" is a res i one. The magnitude of the effect, however, cannot be 
♦!2£ep r Yned from the avail :.UTe data. 

$ • . ' '_ ' 

Other wdrk -he laced cut cQifieS.'' such 6$ j5rc*no:ions > imprined o^r v ■ ■■■•*s . 
Chanced job ?3-fornvin-,> ex;- Ibi ted similar gaim>, witi graiiu tes ±>-^/ ; -\*j_ 
Ninef ?t ; :hq inrre ..thin ripri-gr£«dUo tes. Perhaps thk most uD.iv w nj eyi<:^ o 
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program impact is the fact that roughly two-third of the telephone sample 
and three-fourths of the graduates reported imprbvemerit in their job performance 
For thi fbtiiier group especially* it is difficult to see how this effect could 
be due to factors other than program participation. 

Overal 1 , then, the message seems to be that, pet ~t re oat ibri in ABE pays 
off, albeit sometimes modestly, in the domain of eiirp ioy^^rit and work. In 
addition, a closely related positive effect was .a substantial decline in 
dependence on public assistance. Finally, it seems reasonable to infer that 
work-related gains and emancipation from public assistance are likely to 
affect (and be affected b ; :^<iti ve indirect effects* such as enhanced 
self-confidence and self-r-tc <s*w 

Academic Outcomes 

Not surprisingly^ the great majority of participants reported that ABEL 
helped them to improve their reading^ writing j> asid mat;" skill s • Perhaps 
mora important for many was the fact that they applied their newly gained 
skills to the demands and tasks of everyday' lifers This was particuarly true 
for reading, which probably ref lects_both the emphasi^ on reading in the * . ... 
curriculum and the ubiquity of reading tasks and opportunities in the world 
outside the classroom. Particujar^y significant, in |ur f view, is the~~nature y . 
of "other things learned" volunteered byhalf of the_s§mp1e. In addition to '* 
the' expected jscience, social studies ),^more than .a tFnrd indicated they had 
learned to communicate with or relate bettervto others, that they had _1 earned 
how to learn ]ennanced their. study ski 

or they had grown as persons through sel^-di scoye^ t or^gaining conf i 
self-esteem. It is particularly noteworthy that thesej!^other lea rnings" were 
volunteered by the respondents, not checked off in response. to predetermined 
categories, fin conclusion, the respondents, told us that they were acquiring 
and applying fthe three R_' ; i and that many of them were developing in other 
important ways not directly related to the foraal curriculum. 

Affective Butcomes- ■ * . a 

j As noted above A learning ih_ABE is not confined to the cor^ dcademic 
subjects i n, the formal curriculum. Although titled^ "af fecti ve outcomes , " 
this section also deal Is wi th 1 yarning. Broadly defined, learning means 
change in behavior^ Including not only observab 

acqui sition but change in attitudes, values, and s^lf-cqrcept. !.i fining in 
this br ader sense was truly impressive among ABE participants, both in i^s 
scop3 a d significance. More than nine out of ten respondents reported that 
they fey* better about themsel ves as a direct result of ; parti cip^ting in 1 
ABE . Wher, asked >;hy, about two-fifths cited: a sense of person?/; accomplish" 
mant and a fovrth said they had_ gained greater, sel ^confidence or sel f -esteem. 
Another fourth said that improvement in the i r acrademic ski 1 Is was the pri nci pal 
factor in the: feeling better about themsel ves. As noted in. Chapter 5, in 

view of the generally low levels of self - iteem and self-confidence among? — 

this peculation , these affective outcomes _ \re of major significance. ^ Not 
only are they important as endsin themr^lves, but they 5 re requi sites for 
continuing personal growth and accomplishment both in ihe classroom and the 
world outside*. 
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Principal Benefit Gained from ParB^ipatiw 

The valicli^^d^grLif icance of the findings on affective outcomes 

are strongly supported by participants 1 perceptions of the "one inost - 

important benefit", they gained from participation. As .noted in Chapter 5, 

the most striking/finding was the large number who reported indirect, affective 
outcomes related to self rCdhf idehce or self-esteem. Almost asmany students 
(roughly a third) specified enhanced self-confidence or self-esteem as, the 
major benefit of participation as specified Improvement* in academic skills. 
Moreover, despite the fact that approximately a fourth of the respondents 
had earned a high school diploma, only 10 percent mentioned the diploma as 
the most important benefit of participation. 

.... . , _ _ . _ * 

What are the respondents telling us? Basically, it seems, two things. 
First that a great '..any lack self-confidence and/or self-esteem and, that for 
varying reasons, participation in ABE has helped enhance their self-confidence 
and self-esteem. Second, they are voicing their belief in the importance to 
them of improving their basic academic skills and affirming that indeed they 
have improved the r basic skills proficiencies. 

Other Outcomes 

As previously stated, basic skills students enroll for a variety o* 
reasons^ not all of which directly correspond tp the -official .goals of the 
instructional programs Those reasons that do mot can be considered ultimate 
ends for participation that are facilitated by the acquisition of reading, 
writing, ant' computation skills. 

• Personal fioal Attal nment . Whether directly or indirectly related to 
instructional objectives, individuals goals for participation _arel clearly of 
paramount importance. . In this regard, the message from participants i<» 
resoundingly positive* Roughly one in seven reported. that their goal ( >) for 
enrolling had been "totally 11 reached, with another half res poking thai: ABE 
had helped "a lot;" Only about one in eight indicated minimal progress 
toward their goal (s J; 

The most frequently stated personal goal was to obtain a GED or 5-Jult 
high school diploma. After only seven rx^f.hs in the program, riecrly _a fourth 
of the participants had obtained this objective. Thus the "herd evidence"'' 
lends support to the crudibl lity of tli« highly encouraging sfiif-repovc data on 
personal goal attainment. 

Kiirther Education and training . An important' official C9*l of_A3E is to 
prepe.ro participant!' for further education and training, particularly r-airithg 
for specific jobs* Interesting^, only about i fourth of_ the telephone survey 
respondents saiu that further educ*i^rn or training, cr getting a job or 
better job, was their principal reason/ for enrolling. However, more than, 
three-fifths indicated', in response to a subsequent question, that they planned 
to enroll in oostsecondary education or training programs within a year. L 
Most* as expected, planned to study-sub-prof essiohal vocational subjects _at 
community colleges or publicly supported vocational -teehrr cal schools. The 
follOwHip i survey of GED and adult high school graduates f und that three- ; \ 
fifths of the sample actually did continue their education, thus lending 
credibility to the t? plan to" data; at least for the 3 who earn a diploma. 
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Children in Sch ool. There is little doubt_that participation by parents 
in ABE has significant indirect effects on {1 ) their interactions with their 
children regarding school I and (2) - their children's attitudes and performance 
in- school. These findings were discussed- and interpreted in some detail in 
Chapter 5. Consequently, all that will be said here is that they underscore 
the general pattern of significant outcomes that are in no way directly related 
either to stated curriculum objectives or to the officially articulated purposes 
and priorities of the Adult Education Act.. Put simply, many of the most 
important positive outcomes of ABE are indirect effects of participation rather 
than direct effects of formal instruction. 

Comparisons with other Follow-Up Studies 

Only rough comparisons can be made with the findings of other large- 
scale impact studies because of .differences in sample characteristics, time 
frames, response rates* and a number f of bt^er such factors. In addition, 
previous studies asked -relatively few comparable, questions, as wel 1 as fewer 
questions general ly* and utilized. fixed-answer ratheft than open-ended formats. 
Despite thesecaveats^ some useful comparisons are possible. Significantly, 
the relevant findings of past research t..- d to be roughly in accord with our 
own. For comparison purposes, differences between our f indi ngs and those of 
past studies of plus or minus !0 percent or less can be considered 
inconsequential. 

Outcomes for GED Graduates * 

The anly comparable follow-up study of adults who earned a high school 
c cedent ir" was that recently conduct ed by Cerverb (1983) i A national sample. 
if GED graduates was surveyed 18 months after earning their diplomas (our 
ci^e .fr3i:.d was 12 to 18 months). Gervero focused on dob-related outcomes and. 
participation in further education and training. Tab?| 6,-1 contrasts Cervero's 
i; ridings with our own. 




\ Table 6-1 

E viparisbri of. Present Study 's Findings with Cerverc's Folt*ow-Up of GED 

Graduates, in Percentage • \ 

, ' ) 

~ ■■ — ■' _ ; — 7~. — _ 

Outcome x Present StudyU Cervero 



Obtained Job \^ 45 52 

dob Promotion \. ■ 29 20- 

^Enrolled in dob Training\ - 

Program or Technical School 31 ■ : 24 

**Enrolled in College ^X, 2 * 51 



*Cervero inem: "admitted to job training program" 
**Cerverci item: ''adffifttfcd to educational institution"* 
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As Table * :\' shows, Ceryerp's outcome findings were. quite sjmilar to 
our own* Two_df hi;s original items* "keep jobs" and "salary increase*" 
were omitted frcift the table because of significant differences between his 
wording of the items and ours. . 

Employrent and Further Education Findings i*y'i> ! .-; 

Two major studies that were not>.GED follow-ups, but m5re comparable to 
bur telephone survey of enrolled students, reported figures on employment, 
gains and further education arid training: (Boggs, 1979] Kent, 1 973 )• A" third 
study also addressed the latter outcome (Development Associates, 1980). 
Regarding net employment gains, Kent reported a 12% increase and Boggs a 50% 
.increase (i ncludi ng "got a better job" )• We found a net job gain of 1 6%, In 
addition* 61% of those who chanr^d . : t>s reported obtaining a, "better jobi" 
On the whole, the finding* from the three studies seem to be fai rly; consistent 
Eoncerrii rig plans for fart?.*- eddr.at?ori arid training^ Kerit reported a figure 
roughly comparable to ot • i (abdtit two-thirds) and Bevel opmerit Associates 
reported a figure of 58%. ?or all practical purposes^ these findings are 
identical • " , * ; 



~ Acquisi t iofl-Qf— Et asic S kills Fi adi^ s- 

Tf)e f indl ngs on sel f -reported improvement in Bc3ic sic il'is^ prof iciericies^ 
are only crudely comparable because of di ffer.ences in question wordi rtg, ^Kent 1 
figures are probably depressed because he' used^ rati ng scrile with a positive- 
anchor of "very much" improved. In contrast, Qourstu^ly?. id Development 
Associates 1 asked simply if ABE ha* helped *the respondent improve his or her 
ski 1 Is * Keeping in ml rid that Kent reported percentages, biased on "very much" 
improvement, it seems reasonable to conclude that the following findings are 
pretty much comparable: 

"(1 ) Improved Reading Skills . Kent, 50%;* Development Associates, 75%; 
Present study ^83%. 

(.2) Improved Writiryg Skills , Kept, 33%; Development Associates, 66%; 
Present study.* 63%. ^ 

(3) Improved Math Ski lis. Kent, 46%; Development Associates, 69%; 
Present study, 58%. '■ 

Only one of the major prior outcome studies inquired about application 
of basic skills proficiencies. Boggs (1979) ^oort *ri..that 57% of his 
respondents said that r.hey "read more" and letters more often." 

The corresponding figures for the present 5U ?."3X a.id 49% respectively. 

-The 20% di ffereritial in application of wNtlr.-; - i t i ght attributed to 
8oggs specifying "letters* 11 wfte^eas our response*:,. ; *i e 'not'- constrained by 
the wdrdi rig of the question. fh^^nlriS percent dlffereri V/i-il^f or application 
of reading skills 15 .Inconsequential. 

-* Other Findinas ■ 

Public Assistance 

In addition to the present study, only one investigator examined this 
outcome > Kent reported that ±6% of his sample were initially receiving 
welfare be ief i ts. At the time- of follow-up a year later the figyre'was 2?S& 
a.) insignificant decrease., ;The prbpbrt-ibri &f our sample initially deceiving 
public assistance was nearly iderititical to Kent's (27%U After sey^n 
months^ 18% reported a decrease, iri ptibl ic>assistarice and 15% said tHoy were 
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receiving no assistance at all. The discrepancy between auc .findings 
and Kent's appears to be. significant. However, possible differences in 
labor market conditions and eligibility requirements could account for 
some or most of the difference. . , 

Goal Attainment . ' . 

Development Associates reported that 47% of their respondents had 
"successfully reached" their goals, with 32% "partially reaching them. Our 
findings, on the varf ace. at. least, seem less encouraging. In response to 
the question, "thinking back to your reasons or goals for enrolling In the 
adult education class, has the class helped you reach them total ly* Jl lot, 
some, a little, or not at all?" Thirteen percent said totally, 49% a 
lot," 26% "some,'-' and the remainder "little" or "not at all. There is 
reason to believe, aside fro m di fferences in the wording of the question, 
that the apparent- discrepancy 1n goal attainment 1s questionable. Une 
factor is the low response rate of the earlier study, which probably 
introduced- a selective, positive base. The other 1s tne large differential 
in the follow-up time parameters. It is hardly reasonable to expect total 
or successful goal attainment for large numbers of participants when the 
average elapsed time from enrollment to follow-up is only seven months. 

Children and School - J * 

Both Boggs. and Kent asked parents if they helped their children with 
schoolwork as"a result of participating 1n ABE. Of ^t's resp J^ents 5|| 
replied affirmatively. The corresponding figure for the Boggs study was /9%, 
arid for the present study 75%, Boggs also asked his parent !^pondents if . 
thev "attended meetings at school more Often." A considerably lower 38% 
rXpondld afftrmati vely, as was the casewlth a comparable question Included 
in our own survey (50%). Clearly, Boggs' findings are consistent with our 
ol? Kent's finding regarding help with school work 1s. i neons stent, although 
not grossly so, with ours and Boggs'. Why this 1s. so is not clear. 

Affective Outcomes * 

Of the three principal prior studies, only^that conducted by Development 
Associates probed affective outcomes arid reported them percentage 
dis?Mbutions° In response to an open-ended question, 84% of the respondents 
said that they thought better of -themselves as a result of P^ rc ^^°J] nn .. 
in ABE. In the present -study, in response to a similar question, 92% reported 
"feeling better" about themselves. The credibility of these findings is 
supported by another study of program impact ^Maryland (Walker, Ewert .and 
Whables, 1981). the research focused on changes in people's lives that could 
be at" buted to participation in ABE. The results indicated that the major 
change was 1n self-concept: 89% of respondents reported "feeling different^ 
about themselves" as a result of Participation. In sum, our find: ing that the 
overwhelming majority of participants gained self-confidence or self-esteem 
is consistent with the data reported in prior studtis. 

Conclusion 

Comparisons of outcome findings of the present research . with t^e of 
h**± ^?hhi^ reveal a surprisingly high degree of consistency; This consistency 
' nS only supports thlval?dity l/the'f i nd?ngs Of the present study, but suggests 



92 



that at ieast certain outcomes of participation in ABE may not be much 
different for New Jersey than for Ohio or Maryland or, indeed, for the 
entire nation. It is important, of course, ^to underscore the words "certain . * 
outcomes." Owing to difference's among studies in outcome measures, 
comparisons were limited to a handful of somewhat general findings. 

- Policy Implications " - 

The findings of this study Have implications for federal and state 
policies and program priorities. In New Jersey, and most other states, the 
major sources of funding for adult basic skills education are appropriations 
authorized by the Adult Education Act of 1966^ As Mezirow, Darkeriwald and 

' Knox (1975) note: • ; . - 

The focus of the Act is 'education. for adults whose 
inability to speaks read or write the English language 
constitutes a substantial impairment of their ability to 
get or retain employment commensurate with .their real 
ability. 1 By legal definition, ABE means education 
designed to: (1) 'help eliminate such inability . . . ' ; 

(2 ) ' 'raise' the level of education of such individuals 

(3) 'improve their ability to benefit from occupational 
training and otherwise increase their opportunities for 
more productive and profitable employment'; ahd_ (4) 'make 

v^them better able to meet their adult responsibilities. ' * - 

(pp. 2-4) 

As the above summary of the Adult Education Act makes clear, its official 
goals are narrowly utilitarian^ The bottom line is employment and adult 
education is seren not as a right or end in itself, but*as a means for training 
adults to get and keep jobs. ' Bespite tHe Act 's_ vocational training emphasis, 
most states, as well as the U.S. Department of Education, have -construed its 
mandate Very broadly, emphasizing the "raise the level of education" clause. 
Nevertheless, particuarly in recent years, the *poli tical climate has been 
such as to encourage more emphasis oh vocational isnu This emphasis is most 
clearly evident in federal and state policies cal^ng for cl'oser linkages . 
between ABE and federal ly-f unded-job training programs. ; 

A potential oounterweight to the stress oh vbcationali sm is President 
Reagan^s new "national literacy initiative. "But the emphasis of the initiative^ 
seems to be on private sector voluntary action in the form of one-on-one 
tutoring for total or near-total \] I literates. It 1-s- likely that programs 
funded under. the Adult Education Ae^v^ijT play a margi nal role in whatever 
comes of the, "Initiative." In any evfertt, to date the President has failed to 
match his rhetorical commitment with additional funding for adult basic 
education. 

The findings of this study, and of simile studies, reveal^ a certaio 
s degree of i ncorigruencebetween the stated goals of the Adult Education Act 
and the goals articulated by program participants. Naturally, any lack of 
congruence in goals will result ina corresponding lack of congruence between 
intended and actual program outcomes. ; 
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The present study found that fewei\thari 20% of ABE_ participants enrolled 
primarily, to get a job or better job. Approximately, 26% did get a job or 
better job, but this, outcome cannot be attributed solely to program effects; 
To prepare for f u rt her- edu cat i on or training was mentioned by 9% of 
participants as their primary rpason for enrol li rig. However, despite the* 
secondary status of preparation; for further educatibrvas an i riiti al _ goal i 
nearly two-thirds of the telephone survey sample stated that they planned to 
enroll in some kind of postsacohdary education or training program, arid indeed 
a roughly equal proportion of GED and adult high school graduates actually 
did so. Presumably, a majority of those who enter trairiirig or educational . : • 
programs eventual ly obtain a job or better job* Consequently, in respe'ct to 
employment, the iridi rect i ultimate outcomes of participation seem to partially 
' fulfill the intent of the Adglt Education Aet at least for those participarits 
who have any weed or interest with >espect to. obtaining a job or better job. 

_ Where* then* lies the latk of congruence betweeri policy arid program 
reality? Firsts arid most obvious, is the fact that getting a job or better 
job is ribta relevant goal for a targe proportion of program participants, 
, particularly mature adults as opposed to recent school dropouts. Second; 
most of the important outcomes or benefits of participation in ABE riave 
little vbr nothing to do with employment. Finally, the accelerating trend 
toward linking ABE directly with job trairiirig i programs poses a threat to- the 
fundamental ly educational nature* of mpst programs as they are presently 
constituted in New Jersey arid the majority of other states. To the extent 
that ABE becomes thfe handmaiden of vocational training* it will (1) no „ v ; : 
longer meet the needs- of large numbers of undereducated adults; (2J its * 
impact on the gerieral quali ty .of people^s lives will be limited; and (3j, as 
Smith (1984) suggests, it will increasingly become an alternative to completing 
secondary school, thereby attracting large numbers of alienated adolescent — — 
dropouts. These observations should in no way be construed as denigrating 
the importance of cl bser lirifcs between ABE and yqcationaltraining. The 
need is obvious, indeed urgent. The [Joint is that policymakers should be ~ 
alert to the potentially dysf unctiona:] consequences of placing excessive 
emphasis ori coupling ABE with job training. 

Impact- of Adult Baiic, Education 

Our findings suggest that the impact of adult Basic education in New 
Jersey is substantial, both for individual participants and for the larger 
society. For the majority of individuals, ££e direct and indirect outcomes 
of participation are numerous and significant. The direct effects, that is, 
thgse linked closely to general curriculum object ives^ include not only 
enhanced proficiency in the basic academic skills, but the application of these 
newly acquired abi Vitje^ to the 1 functional demands of -everyday life, Also'of 
importance are the "other learnings" that in general are less closely tied \^ 
to formal curriculum priorities. These include enhanced interpersonal ski 1 Is, 
"learning to learn" (manifest in greater self -di rectednelss , improved study 
ski 11 s , and enhanced self -disci pli ne or planf ul ness j t and personal development 
in the form of self-discovery, greater self-confidence, and enhanced self- 
esteem. ; ; 

Indirect effects are much more varied and equal ly^if not more consequenti al . 
They include gains in employment, earnings, and job^ performance, 
dependence art public assistance, and participation Jn_further education and 
and training. Just as significant, in our view, are the less pragmatic indirect 
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outcomes: marked gains in self-confidence and self-esteem for virtual Ty all 
participants and, in the case of parents, increased concern for their 
Children's school success, accompanied by actual improvement in their children s 
attitudes toward school and school performance. 

TheSmpact on the larger society of the beneficial outcomes described 
above is not hard to discern, immediate gains in employment and reductions 
in public assistance obviously contribute directly to the economic Wei 1-being 
of the state. Probably more important in the long run is the economlc^rnnpaet 
of the thousands of undereducated adults who each year continue. to develop 
their "hum_aji capital" by enrolling in postsecondary education and, training 
programs. The great majority prepare for service or technical occupations 
where the demand for skilled labor is high and likely to remain so- It might 
also be noted that the continuing i-nflux of former ABE participants contributes 
in no small way to maintaining a cost-effective, publicly supported system 
of community colleges and postsecondary vocational -technical schools. Finally, 
the larger society is bound to benefit from the indirect effects of. parent 
participation in ABE on their children's school adjustment and performance. 
In short, the stakes are indeed h-igh in this "last gamble on education, but 
for most of the players the payoff is. substantial ; 
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CHAPTER VII 



A MODEL FOR STATEWIDE STUDENT FOLLOW-UP 

; Need ( \ 

Statewide planning and long-term program improvement have been 
handicapped by i nsufficient information' on the outcomes Df "adult basic 
skills 4 education in New Jersey. At present, local programs lack the 
resources (including validated data collection ins and procedures); 

for "tracking" their basic skills students to determine program impact.. 
As a result*, program improvement efforts have been hampered by inadequate 
out come data; so, too, has local level accountability for state and 
federal funds. At the state level* the situation is similar. Particularly 
distressing* according to Division of Adult Education staff, is that 
incomplete outcome data lead to state accountability reports that severely 
understate the impact of adult basic skills education. Furthermore, 
sketchy data on the economic benefits gained by GEO and adult* high .school 
graduates makes it difficult to conduct costi/berief it analyses that 
accurately reflect the ratio of benefits to costs.. Inadequate student 
outcome data also creates a problem for state-level decision makers who 
need to determine how programmatic. characteristics affect student achieve- 
ment aod cost effectiveness. Finally* there is the heed to diVelop 
feasible and uniform statewide criteria and procedures for collecting 
student outcome data on an ongoing* basis. 

Alternative Approaches 

Three approaches for developing an ongoing statewide system for 
« student follow-up were identified arid their' feasibil i£y assessed. These 
4 approaches were label lied the "Decentralized Model ," the "Contract for 
Services Model," arid the "Centra lized Mod el . " This section briefly' 
describes the ad^varitrages arid disadvantages of each* emphasizing the 
criteria of feasiblity arid costi 

The Decent ral ized M6<Jel 

In brief, the decentralized model assigns responsibility for the 
collection, analysis, and reporting of follow-up data to local adult 
basic skills programs^ Although^ in principle* it can £>e argued that 
local programs should assume these responsibilities, in actuality we have 
found that the great majority cannot and will not. The roet problem is 
that they lack the personnel arid fiscal resources {e.g., for postage) to 
bear the burden of data collection and reporting. Not only did bur . 
advisory board of local practitioners .strongly concur with this conclusion, 
but so too di^d a smal 1 sample of local directors interviewed by phone. f In 
fact r the directors indicated that they were already overwhelmed with * 
"paperwork" requi remerits^ Several stated they would discontinue thei r 
► basic skills programs rather than accept the added burden of col lecting 
student fol II oW-iip data i Consequently - 9 in our judgment, the Decentralized 
Model is simply not feasible. 

The Contract for Services-Model 

The State Education Department could utilize an outside contractor, 
such as a uni ve rsity or survey research organization, to col lect, analyze, 
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and report student follow-up data. . The advantages to such ah arrangement 
include acquisition of high-^evel technical expertise in sampling design arid 
data analysis and the freeing of local program and State Education 
Department personnel from the time and human-resource consuming costs of 
conducting stcfcfent fol low-up. 

• The principa] di sadvantages relate to total cost and cost in relation 
to benefits. A major factor contributing to relatively high total costs 
is the need for the contractor to utilize field personnel to wfark with 
local programs in order to secure lists of eligible students for sampling 
purposes. Our estimate of total costs to the state range from $25,000 for 
a contract with Rutgers to $$0*000 if a survey research firm is engaged. 

In regard to cost-benefit considerations, technical expertise may be 
desirable but it is not necessary given the routine nature of the task now 
that the follow-up instrument has been developed and validated. A 
further consideration that mi litates against the Contract for Services 
Model is' the lack of assurance that the state will have the necessary 
f inanci al resources to engage the services of an outside contractor on 
a continuing basis. Finally, and perhaps most important, this model 'is 
predicated on the assumption that a relatively small number'of programs 
would* be sampled. Consequently, it would preclude feedback on Vocal 
outcomes for the great majority of programs. The above considerations 
lead us to., conclude that the Contract for Services Model is probably 
not feasible or cost-effective* 

The Centralized Model 

... The basic feature of the Centralized Model is that it is designed 
to integrate student follow-up with the Division of Adult Education s 
existing data collection and analysis system. Its implementation would 
requi re very little additional staff time or cost, at the local program , 
level . At the state level, implementation would involve some additional 
stafff time and cost. However, both staff and fiscal costs would be minimal 
because student .follow-up would "piggy-bacx" on the computerized data 
' col lection and analysis procedures already in place. We believe this 
alternative to be both feasible and cost-effective. ; Its principal features, 
are outlined in more detail below. 

Basic Features of Central ized, Fol 1 ow-Up Model . - 

• s . / • - . 

Basically, the Centralized Model would involve utilizing the existing 
Student Record Form in conjunction- with an additional form and a mailer 
to be processed routinely at i ntake by the local program. The second form 
would be a brief, sel f-admi ni stered folfow-up questionnaire which would 
not identify the student, but only the "case" by code number as is now done 
with the Record Form. Of course, the questionnaire would not be filled-out 
at time of enrollment. Instead, it would be inserted into the mailer 
which would come with an address label on which the student s name and 
address would be entered. Finally, a- business reply envelope addressed to 
the Division Of Adult Education would be inserted into the mailer along 
with the questionnaire. The mailer would be set aside for local mail -out 
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on a predetermined statewide "Fol llow-Up . ; Day" approximately seven jnonths 
after the fall registration period. The foil ow-up cjuestlohnairei wou be ' 
keypunched at the Di vision's processing flacil ity along with the Student 
Record Form data and the results tabulated statewide and for each local 
program, which would receive a confidential student follow-up report. 

Such a system would place minimal demands on the local program. For 
the Division, any additional work would be largely clerical and would not 
place an undue burden on the professional staff. Furthermore, the system _ 
would allow for the use of existing computer capabilities arid involve little 
in the way of atided processing costs. 

Operational Alternatives 

To implement the proposed follow-up model requires that decis^ns be 
made regarding (1 ) frequency of fol low-up activities (annually, biannual ly/ 
'etc.); (2) samp 11 n<g design arid procedures; arid (3) reporting policies arid 
procedures. 

Frequency 

Ideally, statewide student follow-up should be conducted on a : 
continuing annual basis. Timely feedback is important for program 
improvement arid accountability purposes, both at th£ state arid local ^ 
levels. However* the advantages of timeliness must be weighed in 
relation to other import arit factors, principally cost and efforts 
Obviously* an annual student follow-up would be twice as costly as a 
biannual fol low-up arid three times a$ costly as a tri annual foil ow-up* 
Although we would exclude the tri annual— bfrt+bn^bn the grounds that the 
-data would be unacceptably untimely, we believe that a biannual schedule - 
is the preferred alternative because the "cost of an aririual fbllbw-up 
may riot justify its benefits 

In reaching this conclusion* a major ^consideration in addition to cost 
and effort was purpose, and utility*' The primary reason for conducting a 
studejit fol low-up bri an ongoing basis is to provide feedback for program 
improvement efforts* If programs X* Y and Z are identified in the 
iriitjal fdll^ow-iip assess successsful than comparable programs in . : ^ 

facilitating, for example* "application of basic skills, then X, Y and Z 
must 'diagnose arid remediate their deficiencies. In ajj probability* 
however, the results of such program improvement efforts are ngt likely 
to be observable over a one-year or 1-ess time frame. But they should be " 
observable* and therefor e u seful, Within two years' time. All things 
considered* then* we recommend that statewide follow-up be conducted on 
a biannual schedule. 

Sampling De s ign arid Procedures * i % 

The most funda^ hot "sampling 

design" but whether the totaj population of programs or a sample should 
Be utilized in-implementing the proposed follow-up model. 

The advantages arid^ disadvantages of utilizing the total population 
of programs [and thus stqdents) are f airily obvious. The advantages i ncludeL. 
(1 J simplicity; (2) reduction of sampling error o (3J biannual feed- 

back that can be provided to every program in the state. Among the 
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disadvantages are: (1) significantly greater cost; (2) th*e need fop a]J_ . . 
local programs to expend some effort in the biannual follow-up process; and 
(3) redundancy: there is no need to survey the entire population of roughly 
30,000 students when satisfactory estimates of statewide outcomes can be 
secured with a smaller random sample. • '» 

' The crux of the decision lies in .the trade-off between vastly reduced 
colts on the one hand and lack -of timely feedback to all local programs on 
the other. Should' the entire population be surveyed, the cost wjf postage 
alone would be approximately $12,000 (assuming a return rate of 50% based 
on bur experience witla the GED/AHS follow-up survey). Additional costs 
(envelopes, reproduction of forms, keypunching and computer time) are 
estimated at $6,000 to $8,000 roughly. Whether or not to spend about 
$20,000 biannualy tq survey the .entire population is a decision-that can 
only be made by the Division of, Adult. Education. 5 

In order to exami ne another option, let us assume that the cost of 
surveying the entire population is deemed unacceptable. Let us also assume 
that it is considered essential that every program in the state receive 
r follow-up feedback once every two years. The following sampling procedures 
would then obtain: 

(1 ) The entire population of adult basic skills programs would be 
listed (N. = approximately 130). A 50% sample would be randomly 
selected using a table of random numbers. This sample would be 
designated "Sample A." The remaining- 50% of the programs would 
be designated "Sample B."' 



(2) Programs established after the selection of the initial samples' . 
would be randomly assigned to "A" or "B" (a coin toss would suffice^. 

(3) .The follow-up sample for year one would, be "A." In year two \ 
the follow-up sample would be "B." In year three 'A would \ 
again constitute the follow-up samplSf*with this sequence 

repeated indefinitely.- '. • _ _ , 

" ; . ' ; . V . • ' 

Reporting ' - ^ 

It is recommended that aggregate' statewide findings, beginning with 0 ■-■ 
thenar?, one "benchmark" follow-up, be reported to all programs n the 
"stafe. fin addition, those programs constituting the sample should receive 
a breakiWn of findings for their Own students so that they can compare 
their outcomes with statewide norms. However, to,avoid invidious and . 
perhaps misleading comparisons and to mitigate the general level ot . 
threat ^individual programs should be guaranteed that their outcome data • 
will "belhel d 'i n strict confidence. : In other words, they x should be" assured 
that only authorized officials of the State Education Department will have 
access to individual program data. ' * . ' 
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I h st i^u mentation 



A student follow-tjp questlonnal re was designed in accordance with 
the following criteria.. First, to ensure a maximum return*rate, ft had 
to be short — one sheet printed on both sifJes. Secoad § items had to be 
clearly' worded in simple language; complex "skip to" questions could not 
be included. Thi rd, the majority of items should address tangible outcomes . 
rather than attitudes anjUopinions. Fourth, the items should tief of utility 
both for program improvement arid accountability purposes^ Fifths the 
quest ionnai re. should be as comprehensiye as possible, including items 
addressed- to human capita* Investment^ ^personal development^ and economic 
outcomes arid both the di rect arid Indirect effect's of participations 
Finally, the questionnaire should s consist of the most "workable" apd 
significant measures of program outcomes as determined by the results of' 
the present research. 

In ebristructirig the questionnaire, the only criterion listed above 

th^t presented difficulties was the second. Although it was deemed 

desirable to utilize all items. in their original form, some appeared pot 
to^be worded or formatted as simply as possible; should be recalled 
thffc the original data were obtained by teTephon«p The qUestiol^ were 
fead to the respondents and repeated or^clarlf led as the need an3|e. A 
self-administered : questlonnal re, however^ regui res that respondents be able 
to read and complete all items -without assistance. 

To address this latter issue, two forms of a prototype instrument \ 
were deyel oped and field-tested with 24 adult basic skills student?. 
<0ne form consisted of it ems " lif ted" frbm the telephone survey instrument T 
The second c omp rl Is ed7"s 1 mp 1 e 1 a nguage " items designed to el4cit comparable 
data. The second form was found to be^fnarkedly superior: only a fetf 
1 o^l eye1_ readers had any difficulty >e^jng_and_c^p : 1et1ng it. These . . 
persons were subsequently interviewed to pinpoint the sources of difficulty, 
which were mostly unfamiliar words or terms, such ais "emp 1 oyment . status . " 
These and other mi nor problems were easily rectified. The final version 
of the Statewide Student Fol low-Up "Questlonnal re Is reproduced in. 
Appendix D'. 

: Datfr Processing Eroeedures 
* 

It is essential that the same* five-digit student or "case" number . 
currently- imprinted on the Student Record form also be imprinted or written- 
in on the Student Fol low-Up Questionnai re. This also applies to the six-digit 
county and district (program) code. Unless this is done, it will not be * 
possible to match-up the student data from the two forms to permit 
comprehensive analyses relat1ng~student and program characteristics to 
student outcome findings. • 

The Student Fol low-Up Questionnaire was designed to be "self-contained." 
That is, it contai ns al 1 the information needed -to generate comprehensive 
outcome data without recourse to additional data from the Student Record 
Form. Hpw.ever^ because of space limitations, the Fol low-Up Questibririai re does 
not provide the following jnfonnatlbn which provided on ^ the Student 
Record Form: (1) age, (2) sex, 43)^ prresehce of a handicap, (4) citizenship, 
(5) race or ethnic group, (6) reading leVel, (7) Instructional- program (E£L* 
bilfngual basic skll Is, etc.), (8) hourly attendance by jrorithi arid (9) reasons 
for d1 scent inui ng participation. ; — : " 
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* For certain purposes, the Division of Adult Education, may -wish to 
crosstabulate background data fronTthe Record Form with outcome data f rom _ 
the FolHw-Up Questionnaire. For example,. it may be useful to determine if 
outcomes differ by geographical region or by program characterises* such 
as size* student composition, average hours of attendance, etc. .Hence 
the importance of matching student and program (distri ct) codes .for the 
two instruments. To reiterate, unless this is done it will not be possible 
to examine outcomes in relation to student background and program 
characteristics. • 



Co n cluding Note 


If the necessary human and fiscal resources ape available^ local adult 
basic skills programs can utlHse the appended Student Follow-Up Questionnaire 
whether or not a statewide follow-up system- is implemented^ .We believe, too* 
that the Follow-Up Questionnaire items are sufficiently generic to warrant 
the tree of the instrument by local programs in states other than New Jersey. 
Benchmark data for judging and interpreting local outcomes can be obtained 
from the statewide norms reported for the relevant items in Chapter 5 of this 
monograph 0f course, since the norms were established for programs in 
New Jersey /they should be vi ewed as only rough benchmarks for interpreting 
outcomes in other states* "* ^ 
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APPENDIX A 
ADULT EDUCATION FOLLOW-UP SURVEY 
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ftutgers Uhi^rsity 
Center for Adttff Development 



mcAvthfi Fnttnw-iip survey. 
—7* 



Interviewer Respondent's Name VSf 

• j ) •- • — — • . 

nate Completed [ • Telephone sNgmber 



' ( 

Start Time ~ ."Program Name v , TfiF 



Finish Time * Program Address 



. A 

- -V - - 

FT^eT 



A; Hello, may I speak to 



(IF CONNECTION IS MARE), Go to B below. — =s* 
(IF NOT HOME) , Ask when to call again or how else to reach respondent. ^ • 
Enter Response Below. ; _ _ 

( NOTE , If asked to identify yourself, give your name and 
; s<*y: "I'm from Rutgers University and I wanted 

to ask him/her some questions about education. " ^ 



R. This is from Rutgers JJnivesity. We are conduc- 
ting a study to help schools improve their, a^lt -education elasses^- 

is one of ^he^prbgrarns we're working wtth. I'ni 

calling to ask if you would help by answering a few questions. -We're asking 
the same questions of other students from ' — * 

Your answers are Very important and completely confidential* All answers will 
be used; without names; ' , . 

' Section I 



1. First, we are interested in knowing the reasons people enroll 
in "adult education classes for reading and math skills. Think : 
back to when you first enrolled in the program (PAUSE). What ; 

— were ~you r~rea son s or goals for enrolling? (PROBE: , We re there others?) 
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Which one of these reasons was the most important to. you? 



Why did you enroll at that particular time? Was there something 
happening in your life that made you decide to enroll? 



Once you enrolled, was the adult education c§urse what you had expected 
it to be like or was it. different? . e 

1 EXPECTED 



( IF DIFFERENT) , How was it different? 

there things you didn' 



[PRDRE: Were 
t like?1 



2 DIFFERENT 

3 UNCERTAIN 



Thinking back to your reasons or goals for enrol 1 ing in the adult- j 
education class, has the class helped you to reach them:_._ 

1 "TOTALLY 

(IF, NOT AT ALL), Why do you think the class 2 A_L0T 

hasn't helped* you? - 3 SOME 

A A LITTLE 
5 NOT AT ALL 



Now I'd like to ask you about some problems adults often^exjjerience 
in going to classes. After I read each statement, please tel>-me tf it 
is very true, somewhat true* or hot true. 



a. You didn 8 1 feel you were making enough 

progress "toward your goals 
* * 

b. You didn't receive enough help or 
attention in class 

* • 

The classwork was harder than you 
expected, 

j. You didn't get support or encourage- 
ment from family or friends 

?. You had trouble attending class due 
to job dreamily responsibilities 



Very 

3 



Some 



Mot 
1 

1 
1 



*an you think of any other important problems you had, things you 
lidri't like or that made i t hard to attend class? 
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3. Of.all the problems mentioned, which was the most serious or 
difficult for you? 

X 



v 



9. Are you still attending the adult education class or .have you 
stopped attending? -, ' , 



(IF STOPPER), Why did you stop attending? 



1 STILL 

2 STOPPED 



(IF STOPPEH) , no you plan to start class again 
later this spring or next fall? 

x Section 2 . 



1 YES 

z m 

3 UNCERTAIN 



Now I would like to ask you about some of the benefits you might' 
have* gained from going to the adult education elass^ 



10, Were you employed at the time you first entered the 
adult education program? 

IF NO, GO TO OUESTI.ON 11 

(IF YES) i 00 ybu have the same job now, did you change 
jobSi or did you recently become unemployed? 

(IF SAME), GO TO QUESTION 12 

(IF UNEMPLOYED), GO TO QUESTION 13 

* _ _ - ----- 

(IF GRANGE), Compared with your last job, is 
the job you nqw have 

(IF BETTER JOB) , Old the adult 

■ education "program help 
'c you in any way to get 



\ 



the 30b you now have? 



(IF NO OR UNCERTAIN), SO TO QUESTION 12 

L 



1 YES 
? NO 



1 SAME 

2 CHANGE 

3 MNFMPl.OYPn 



1 A RETTFR ,10R 

2 AROIIT THE SAME 

3 A WORSE JOB 

1 VES 

?. N(S 

3 UNCERTAIN 



(IF YE.S), How did it help? 



GO TO QUESTION 12 
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1. Are you employed how? " 

A 

If NO , GO TO QUESTION 13 

(IF YES), Before you got your job, "had you been 
receiving unemployment benefits?^ 

• - ' V - 

y _ ■ _ _ , •_ _J/ 

•(IF YES), Did the adult education program help jrou 
in any way to get the job you now have? 

: ; - "- . . f 

(IF... YES), How did it help?' 



1 YES 

?. NO 



1 Yes 



1 YES / 

2 NO 

.3 UNCERTAIN 



2. Regarding your present job, in the last six months 

a. Do you feel you. are doing your job better? 

(IF YES), Has the, adult education class 
helped? How? 



1 YES 

2 NO 

3 UNCERTAIN 



t>. Did you get a raise? 

(IF YES) , Did the adult education class 
>? How? 



- 1 YES 
2 NO 



:-. Oid you get a promotion? 

(IF YES), Did the adult education class 
help? Haw? 



1 YES 

?. NO 



i. Do you think you're more likely to keep your job? 

(IF YES), Did the adult education class 
help? Row? 



1 YES 

2 NO . 

3 UNCERTAIN 



GO TO QUESTION 14 

!. Are you currently 1 ooking for employment? 

(IF YES), Do you think the adult education 
class might help you get a job? 



(IF YES), How do you think it|might help? 



1 YES 

2 NO 

1 YES 

2 NO 

3 UNCERTAIN 
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14. Has the adult education class helped you become 

a better reader? 1 YES 

; - ?. Nh 

15. Since enrol 1 irig in the class hsy'e you used your < 

reading skills outside of the classroom to do * ' 1 YES 

something you couldn't" do before or to do it better? 2 NO 

(IF YES) , What are some things you have done or can now 
do with your improved reading skills? [PROBE: 
■aread recipes, Want ads * the mail , magazines, 
~:hirigs like that] 



ifi; Has the adult education class helped you to Write better? 1 YES 

- v ?. NO 

17. Sinjce enrolling in the class have ybu used your 

wr/ting skills outside of tfie classroom to do 1 YES 

something you couldn't do before or to do it better? 2 NH... 

(IF YES), What are some things you have done 'or can db_ 

now with, your^imprbved writing skills? [PRDRE: « 
• fill out forms, write letters or;, notes, 

things like that] 



18. Has the adult education class helped you improve your math 

skills? - 1 YES 

; 2 NO 

19. .Since enrolling in the class have you used^your . 

"7 math skills outside the classroom to do something 1 YES 

you- wouldn't do before or to do it better? 2 NO 

(IF YES) » What are some thingsypu _haye dpne or can dp now 
; ' v with your Improved math skills? [PROBE-: 

* balance a^check ""topkAjipepapela._tax return, . : 
compare prices, things 1 ike that] 

i ■ .J 



20. Aside frpm reading, writing, and math, were there any 

other' things you learned in the adult education class? 1 YES 

(IF YES) , What other things? 
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21. bid the class help you pass-i+re^GEri exam op earn 

an adult high school diploma? . - • 1 YES 

- ' : ^ s 7. ! Mh 

(- 1 F YES) > nid completing high school 

enable you to get a license or 
certificate or in some other 

way help you to qualify for a , 1 YES 

specific job or trade? 2 NO 

(IF YES), What license did you obtain or 
what trade or job 'did you 

qualify for? , 



22. Ho you have any school -aged children or 
teenagers living with you at home? 

(IF YES), Has your participation in the adult 
education class resulted in any of 
' the_ fol lowing changes? 

a. Do you help the children with their school work 
more than you used to? 



b. Do you talk with them more than you used to 
about schbol? , 

c. Have they developed a better attitude 
toward school? 



1 YES 

. 2LCBL. 



1 YES 

*2 NO 

1 YES 

2 MO 

1 YES". 

2 NO 



d. Are they now getting better grades? 



e. Have you become more involved with the school , for 
example by attending meetings or o^her activities, 
or tg/lking with teachers? >> * '_.„, 



1 YES 

2 NO 



*1 YES 

2 NO r 



23. In general A do you feel better about yourself, 
the same or worse as a result of attending 
the adul t education program? 

(IF BETTER), Why or in what way do you feel 
better about yourself? 



1 SETTER 

2 SAME 

3 WORSE 
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(IF WORSE), Why or in what way do you feel worse 
about yourself? 



?4. Aside from the class we , ve_been_taiking about, §re 
you currently enrolled in any. Mr\<\ of training or 
education program? ■■'../•; 1 YES 

, ; ? NO i 
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(IF W)* HO TO nUESTION 25 

(IF YES) , (a) mat are you studying? 



( b) Where are you studying it? 

(name of school, college, agency) 



•* (c) Did the adult education class help you 

get into, prepare for, or find out about 
this program? 1 YES. 

7. NO 

GO TO QUESTION 26 

" ~r 
/ 

' _ - • ■ V 
25. Do you plan to enroll in any kind of training or education 
program in the near future—say within 6 months 
or a year? ) 1 YES 

2 NO ^ 

(IF YES), (a) What' do you plan to study? • 3 UNCERTAIN 



(b) Where do you plan to . study it? 
(PROBE: college, employer 
vocational -technical school , trade 
school ) 



25. Many people these days ari recei ving "pub! ic assistance, 
such as ADC or food stamps . Have you received such 
assistance at any time during the past year? 1 YES 

' 2 NO i 

(IF YES), Since October has the amount x of assistance % V 

decreased^ remained about the same, or been 1 SAME 

totally eliminated? 2 DECREASED 

*__ _ _ _ ^ » 3 ELIMINATED 

(IF DECREASED OR ELIMINATED), Was the reduction in public 

assistance due to your getting a 
job, your making more money, or 
« . •/ '. > to something else? 1 GETTING, ,]0R 

... 2 MORE MONEV 

. - 3 SOMETHING FLSF 

27. One final question. Taking everything into account, what is the one 
mdrst important benefit you gained from participating in the adult 
education class? 
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THANK YOU VERY MUCH FOR YOUR HELP. 
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ADULT EDUCATION STUDY 

■ ' 

THANK YOU FOR ANSWERING THESE QUESTIONS. YOUR ANSWERS ARE TOTALLY CONFIDENTIAL. 
NO ONE WILL KNOW YOUR NAME. : 

A; x This section asks about changes that might have occurred in your life since 
earning your high school diploma. Please circle either Yes or No. 

1; Since earning your high school diploma: ) 

a. Have you enrolled iri college? . . Yes No 

b. Have you participated iri a job training program? . . .: . . . Yes No 

c. Have you enrolled in a trade or technical school ^^rTT / . . Yes No 

d. Do you feel you set a better exm^e-ftir your children? .... ... Yes No 

e. Did you improve your reading or writing or math skills? . . . . . Yes No 

f. Do you know more about how the government works? . "'. ....... Yes ^Ho 

g. Do you feel better about yourself? ............... Yes No o 

h. Are you now able to do your job better? . ............. Yes No 

i. Are you now more likely to keep your job? ............ Yes No 

j. Did you get a better job? . . . . ./. . . . . . .. . . ... . « Yes No \ 

k. Did you get a pay increase? ........... - ...... . Yes ,No 4 

1. Did you get a job promotion? .................. Yes No : 

B... This section asks questions concerning employment arid ybur opinions about 
adult education. 

1. At the time you officially received your diploma, were, you employed 
(Check one) : 

/ 17 Full-time? / / Part-time? j I Not at all? - 

2. Are you currently employed .(Check one): 

/. / Full-time? . / / Part-time? / I Not at all ? c 

3. If you are unemployed, are you seeking employment now? Yes No 

4. In the year (12 months) before ydu earned your diploma, how many months 
were you employed, if any? . : _ - -- 

Number of Months 

) ' . " . ■ 

5. In the year (12 months) aftfer you earned your diploma, how many months 
were you employed, if a-ny? v : < ., ... 

: ; ■ ; f ^ h * Number of Months 

o . - .-■ \*ty*r. , \ ■ lit? • , .. ., • /..,.;__; 
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6. If currently employed, is your take-home pay Hi.gKer now than when you 
officially received your diploma? ' { J Yes No 

7. If your take- home pay is higher how, about how much more per week are you 
making? \ . $ • - ' 

8. Many people these days are-receiving unemployment benefits or some form of 
public assistance, such as Food. Stamps or-ADC. 

a. Before you earned your high school diploma, were you receiving: 



7 / Unemployment benefits? / / Public assistance? I — / Neither? 

Are you currently receiving: 



■ I I Unemployment benefits? / / Public assistance? / I Neither? 

9. Please circle the response that best describes your opinion concerning the 
, fol lowing statements: 

a. The adult high school I. attended was very helpful in preparing me to' earn 

n\y diploma. - 

L ■. • • - • ■ i 

Strongly * Strongly 

Agree Agree Disagree- Disagree 

b. If the adult high school was not available to me, I would not have earned 
a diploma. 

Strongly _ ' * Strongly . 

Agree Agree Disagree - Disagree 

c. This section asks some questions about yourself. Please circle or enter the 
correct response. • <J 

1. What is your sex? Male Femal e ! 

2. What is your age? - ■ > 

• Age 

3. Do you have any children 18 years old or younger.?. Yes No 

If you would like to make any comments or suggestions, please do so in the space 
below. • v 



: .. 1_ lit 

r~r!\r 1 THANK Vnil! 

ML 
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STUDENT FOLLOW-UP FQW 

We like to keep in touch with pur students after they leave the program* 
Sometimes we call them up or write to them* just to ask quest ions^afiout what, 
they are doing. We also like to ask them how they 1 i ked our program* Some- 
times they give us valuable suggestions about how we cart make bur program 
better. ' ^ ' \ 

Please take J^few mi rrutes to fill in this form, so that we will know 1 
where to reach ytfu in the future. * 

YOUR NAME _ • [ " , ■ - \ ■ ■ ; \ ^ 

. first ' ! last " \ * . ~ P 

• ' ' . • '.. ' ■■ hi 

YOUR ADDRESS 

^street ~~ , " ! \ apartment number * ~ 



city 



state 



zip code 



YOUR /TELEPHONE NUMBER 



Sometimes our students moy.e* Then wheh .w? try to ijet in touch with 
them, we can't find them. Please give us the" name and telephone number of 
two people who know you very well. These people will probably know how we 
can get in touch with you if you move. 



PERSON #1 



NAME 



TELEPHONE NUMBER 



How do you know ^his person? (circle one) friend 

relative 
other 



PERSON #2 



NAME 



'TELEPHONE NUMBER 



-J- 



How do you know this person? (circle one) friend' 

relative ' 

Ir - 



ERLC 



J 
lift" 
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ADULT EDUCATION QUESTIONNAIRE 



Me want to Improve New "dersey s adult education programs, and 

we need jrotfr help. Would you please take a few minutes to complete this - 
questionnaire and return It in the enclosed envelope? Your opinions are ' 
very important and your answers are completely confidential — nobody will 
<now who; filled out thjs questionnaire. Thank you for your help! 



CIRCLE ONLY ONE NUMBER FOR EACH QUESTION . 

» » 

1. Thfnk about your reasons or goals for going to the adult education class* 
How much has the class helped you to reach your goals? (Circle one number.) 

-T-A-tot 

# ; 2 Some 

.3 A little 
4 Not at all 

2. In general* Has the adult education class made you feel better about 
yourself* the same , or worse? 

" 1 Better 

■ 2 Same 

3 Worse 

3. Did yqjj earn a GED or adult high school diploma? 

1 Yes 

2 No 

If you answered YES^to Question 3: 
a) What kind of diploma did you receive? 1 GEO diploma 

2 Adult high school diploma 

4. Since enrol ling in the class* have you used your reading 
skills outside the classroom to do something you couldri/t 

- do before or to do it better? i ••••••• 1 Yes 2 Nb : 

5* Have you used your math ski 1 Is outside the classroom to do 

something you couldn't do before or to do it better? ... 1 Yes 2 No 

6. Have you ased your writing ski 1 Is outside the classroom to 

do something you couldn't do before or to do it better? . . 1 Yes 2 No 



Do you have school -aged children living with you at home?. 

if you answered YES to Question 7: 
a) Since enrolling in the class* do you help the chili 
with their school work more than you used to? . . 



1 Ves 2 No 



1 Yes 2 No 



b) Do you talk with them more than you used to about 

school? ...................... 1 Yes 2 No * 

c} 1 D6 they have a better attitude toward School? . . . 1 Yes 2 No 

dj Are they now getting better grades? . 1 Yes 2 No 



PLEASE TURN OVER AND COMPLETE THE OTHER SIDE 



9 

ERLC 
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District * 
1-4 ( ) 



5-9 ( ) 



Ql 

10 ( ) 



Q2 

11 ( ). 



Q3 

12 ( - ) 

Q3A 

13 { j 



04 

14 ( ) 
Q5 

15 { } 

M 

l*%v># 

f - • ' ^> 




20 f_j f 
J. .Q7D - 
21- ( • ) 
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8. /When you f irst sta rted the adult education cUss/ were you ^ V ^ 
receiving public .assistance (for example, AFDC, Food Stamps}? l Yes * no 



9;' Are you nowJ%»cei vi ng public assistance? 



........ 1 Yes 2 No 



0. When you fir%t |tarted the adult education class were you: 



1 1 . Are you new : 



1 Employed 

2 Unemployed and looking for work 

3 Unemployed and not looking for work 

1 Employed . f? . _ r 

2 Unemployed and looking for work 

3 Unemployed and not. looking for work 



Answer only <f you are NOW EMPLOYED: 

a) Since starting the adult education cjass, 

did you get a better job? \ ' 165 



v . 

bj Did you get a raise or promotion? . i . 



..... > Yes 2 No 



c) Do you feel you are doing your job better? 1 Yes 1 No 



12. 



V Yes 2 



13. 



Are you still attending the adult education^class? .... 

If you ans wered NO to Question. 12r . . .... 

' a) Are yo u now attending col lege, a job training 

' program, or some"other educational program? • • • • 

Sometimes adults have problems going to classes." Did vou have these 
problems? 



1 Yes 2 No 



a) Trouble attending class because of job or family 
responsibilities . . * • • 



1 Yes 2 No 



Bpfot enough help or attention from the teacher ..... 1 Yes 2 No 



e) Trouble learning things even though the teacher 
tried to help 



1 Yes 2 No 



14. 



Taking everything Into account, what was the |ne ^st important benefit you 
gained from attending the adult education class? (circle one). 

1 Greater self-confidence or feeling better about yourself 

2 Improved basic skills (reading, math, writing, etc.) 

3 A high school diploma or certificate 

- ' ! M&IISyiW > m training progr*n, or sooe dther 
educational program / - 
6 Other' benefit (please describe) — r*- 



22 ( ) 

23 ( : .) 



510 
24 ( ) 



Qll 
25 ( ) 



. QUA 

26 ( ) 
Ql IB 

27 U.J 
Q11C 

28 ( ) 



Q12 

29 ( ) 

Q12A 

30 (. ) 



Q13 

31 ( ) 

Q13B 

32 ( ) 

Q13C 

33 ( ) 



014 
34 ( ) 



r uam? vnii MR TAKING THE TIME TO COMPLETE THIS QUESTIONNAIRE. HAVE YOU 

ER J C W% WwihiohI; Ire, very importanti f oq _ • 



